Listen, I'm a girl and I am completely turned off by any facial hair. The thought of food getting caught on it just grosses me out, plus they're pretty uncomfortable if you're kissing someone- scratchy. The only thing I can tolerate is a five o'clock shadow, and out of someone who had it and another who didn't, I would totally go for the one who had a bare face. (I also prefer bare chests too)
It's nothing to be upset about**- I went to an all girls school, and I think it's a mixed bag of who likes facial hair or not. A lot of girls have no opinion on it. A LOT of girls would also prefer a better personality over better looks- it's looks that draw you in, but personality (inc confidence) keeps you hooked.
TL;DR
Facial hair isn't the be all and end all.
**If you've felt depressed for more than two weeks or are clinically depressed/on meds, please please see a doctor.