No, I would not care either way. It is nothing to be ashamed of, regardless of what age you are. Some people prefer those that are virgins, others don't. It is all about personal preference. If someone refuses to have a relationship (intimate or otherwise) because of your virginity (or lack thereof) then that is completely their issue not yours.