I got through Physics AS without doing maths and passed. Yes I got an E but that was wasn't due to the lack of maths, it was simply not being very good at the subject, regardless of it being my favorite.
It's only now doing A2 I am encountering things that required maths, however they're fairly basic. Just some logarithm stuff but I picked it up pretty quickly and only got a B at GCSE maths.
I wouldn't say maths is that important, but who knows what I could've got last year if I had taken maths, its difficult to tell.
Good luck