I used to feel the same way... but then I met my boyfriend, who is 3.5 years younger than me. Before we started dating I thought it was weird, but in the end, the connection between us has completely outweighed it. So I'd probably say, it really does depend on the person in question.