Rather than you, as an individual being unattractive, I find it has more to do with what others feel comfortable in doing. It's very hard to explain. If, say, we're talking about a trans person who wishes to change their sex to fit with their identified gender, but has not yet transitioned, I understand some may have issues with this if they only find a certain sex attractive (lets say a hetero man wants to date a trans woman, but they have not yet transitioned to have female genitals) then I could understand why someone wouldn't date a trans person in that case. However the issue is incredibly delicate and is different in every case. Me, personally, am attracted to men and women, but that also includes non-binary men and women (i.e, trans people) so I generally would have no qualms about dating someone transgender. As mentioned above, some people are simply attracted to binary men/and or women. Some, even, may identify as pansexual and generally wouldn't have an issue about sex/gender.
Don't worry if some people appear not to be attracted to you. They're either unnecessarily close-minded and rude, or they simply have preferences/identify differently in terms of sexuality. There are always going to be people who find you attractive! And also, anyone who believes that stereotypes in the media are factual portrayal's of an entire group should seriously consider re-educating themselves.