First of all, bravo for actually having the drive to get fit again! I keep telling myself I'll do more exercise to tone up more but I never really bother. I doubt anybody would think it silly you wanting to do a sports subject at uni. Do what you love! It's not like you're ironically obese or anything, just a few pounds to lose if anything.
Do they actually matter?