I think the term attraction is an ambiguous term. Even if it's something more specific like "sexual attraction" or "romantic attraction".
Because there's no way for me to know if my feelings of attraction are the same feelings other people experience.
Yeah, but that can be said for just about anything. We're limited by our inability to read minds . How do we know everyone sees color the same way? So no, perhaps you'll never know what attraction feels like for someone else. But you're wandering into the territory of arbitrary questions that can never be answered.