Pro-immigrant groups warn that the controversy can not, and should not, be just about free speech rights on college campuses.