Dating someone from a different Socio-Economic background

What do you guess think about dating someone with a different socio economic background than yourself. I honestly never gave much thought to it until my current relationship, I'm from an upper class family and my bf is from a middle/lower middle class family. In the beginning I didn't really think anything of it since we were both still in college and young, I'm 19 and he's 22. But as time has gone on, I've noticed we have very different approaches to money.

I've never had to worry about money and I can kinda spend what I want, while he's always worrying about money. But the funny thing is I'm the cheap practical one and he's not. If I don't have to money to do something unnessaecary I just don't do it. I was raised to pretty much live within my means, my family has no debt. My boyfriend on the other hand doesn't have that much money, but is eating out constantly and spending money he really doesn't have and it kinda drives me bonkers.

He's mentioned that if we do work out long term that he'd feel guilty for most likely depending on me for financial support, I'm a computer science major and he's a sociology major. That kinda freaked me out since as much as I try to tell myself mine doesn't matter, it does to some extent. And I just sorry that our different background might conflict at some point.