Hey, I would say it's not much to worry about, in my accommodation I'm friends with two people ages 21 and 23 (whilst I was 18, now 19), no one particularly notices age differences, and they definitely wont care if you're older.
There's a mature students social club that you could also join, and I have many first year friends who would skip out on going out in order to go to work, it's normal!