I'm just under 5'8'' (not tiny by any stretch of the imagination, but noticeably shorter than average) and my height has never had a noticeable effect on my life socially. There are odd occasions where I've had other men insinuate that I have some sort of 'short man syndrome' (as I'm also relatively well-built) but it's far from common and not something I'd pay attention to (and I know that in some cases these were men envious of me for other reasons looking to bring me down a peg). I've never had people dislike me because of my height and I've had plenty of very attractive women interested in me, and I think the reason my height hasn't played a factor here is because it isn't something I'm conscious of - I don't dislike the height I am, or envy taller men, or feel like I have a disadvantage I have to make up for. It's one of those qualities that will start to define who you are only if you start considering it so important as to be fundamental to you as a person.
I'd probably be more attractive if I was taller, but then I'd also probably be more attractive if I had a more even smile, or a deeper voice, or wore nicer clothes - it really isn't a particularly interesting issue for me; just one of a number of imperfections, and we all have imperfections. To be perfectly honest, the only area of my life in which I often notice my height is in sports, where it's a disadvantage for certain activities (but then being short has its advantages in others).