I don't think it really matters much beyond say getting your first or second job. My sister didn't go to school and was a cook for a while, but wasn't really taken seriously until she had the ability to put culinary school on her resume. I know that for me, even though I haven't been to culinary school, and this is in the working world in general. The large company I worked for could've cared less where I went to school. I have a bachelours and that's really all they care about, no mention of, ''wow, your GPA was high'' or anything like that. Maybe in your first or second job they'll care, but beyond that it's experience and where you've worked.
Harvard or Yale are nice schools if you can afford them, and get into them. They might also get you a job quicker than someone who attended say Ohio State Uni. Or some other state school (like I'm attending now). I really think it has a lot more to do with what you do whilst in school than say what school you go to. Lecturers can give you recommendations, and sure, they might not be the big name ones like at a bigger school, but that doesn't mean you're any less of a person because you couldn't afford a big name private school, or didn't want to go to one.
I've had lecturers in classes whom taught at a more prestigious university and also taught at the state school I attend. There is absolutely no difference in their instruction from school to school. If you show them you really want to learn, almost every lecturer will show you all that they can. They don't really want to spend any more time on someone who doesn't care when they can show say, you who does.