Not a girl, but they stare at me also too. In my case, I guess it's because I have a terrible physique. They're like "what is that fat (effeminate?) guy doing in our (manly?) area".
Not sure if this is possible in your gym Holby, but at mine some ppl take the weights they need to use over to a different area.