It shouldn't ruin your social life - very few people are sexual with everyone they know.
What is it you're afraid about? Do you want to be sexual with other people? Or is the very idea completely uninteresting (in which case look up asexuality...) Do you enjoy touching yourself?