I honestly have no idea, probably some pop culture romanticisation of the tall guy to protect the short girl. Another is the masculinity complex, men are told they're inferior if they aren't the tallest, and to be a woman's inferior 'what an outrage!'
It's sad that we are so superficial, why should it matter?