TL: DR - don't worry about it, try out as many sports as you can and have fun
At least at my uni, albeit it isn't very sports oriented, I don't think anyone would really realise at all in most sports clubs. The club's I've heard being the most friendly are the sports not many people have heard of, because most people that join haven't played before, so it's got a big social aspect to it rather than people taking the sport really seriously.
My uni does introductory sessions for the sports clubs and I'm pretty sure most other unis do, of really recommend doing these, maybe going with someone and trying out as many as you can, even sports you'd never think you'd do after that one session. If nothing else for a bit of fun, but also you may find something you really enjoy doing