I honestly wouldn't do anything unless I was quite close to them...then I'd probably push them away without realising that I'm doing it because of how uncomfortable I'd be feeling...
Depends on whether they're direct. If I happen to find them likable and they're not playing games with my emotions, I would maybe try to get to know them as a person.