No, that's as daft as saying gin is an elderly woman's drink, etc. If you like it, you drink it. If you like it and you're a prude/sex worker drinking it, you're a prude/sex worker drinking vodka. Perhaps you should tell your boyfriend, if he really is saying this to you frequently, that perhaps you should go be a 'slut', if that's what he feels is suitable. P:
I hate vodka but only after a bit of a stupid/traumatic experience with it as a teen. I also think it's disgusting... But it's definitely the cheapest and most common drink in student venues, perhaps that's what has given your boyfriend the daft notion that it is for the recklessly promiscuous... if I were you I'd tell him to grow up a little next time he mentions it, and let you enjoy your drink.