Yo!
y13 physicist here. To be honest.. yes there's maths, a fair chunk of maths. However, bare with me, as I also hated maths, was (and still am) rubbish at it. The only real maths skills required for physics a-level are;
- equation rearrangement (not too bad)
- trig (eh.. still hate it, but it makes more sense in a physics context)
- Logarithms (The most disgusting horrible, confusing and hateful maths part of physics on my spec, but not a huge part (to do with radioactivity mostly).
Other than that.. you're good. So, my advice? If you like physics, then go for it. Maths is an unavoidable part, but the physics aspects of the maths are quite fun and engaging, so it's not so bad.
Good luck to you!