You're only 15, 16. In education you'll rushed and you'll be encouraged that you have to make choices now or you'll be a bum forever. Truth is, you don't even know what you want to do. What you want to do at 16 will likely change when you find out about the real world.
I mean, what is this 'physics' you want to do? It's like saying you want a job helping customers, it could be so many things.
Anyway, what interests you about physics might point you in the direction of another similar sector which you'll actually end up preferring.
But if you do want a physics-based career but worry about your maths, just because you might think you suck now doesn't mean you will when you're a few years older and wiser. Anyone really can do maths, or anything else really, you only know what you learn. If you don't know basic maths, or slightly more complicated maths, it's because you've had bad teachers or the way you're 'learning' isn't suited to how you are.
You may not go to sixth form, but that doesn't end your life. In fact you might end up better off.
For comparison, at school I got a D in maths, I worked at Co-op and then was unemployed for 6 years. I went straight into college and did an I.T. course because I thought I wanted an I.T. career, then when I sucked at that because I was too young, I did media the next year until I realised I was wasting my time.
However when I retook maths years later (right now), I got A* an A in my first tests. When I did astronomy GCSE, I got an A. I'm going to self-study A levels in the maths and physics field, and then go to university and end up with a PhD in astrophysics or similar (well, easier said than done eh?), and have multiple career choices by the end of it.
Like a boss.