A-level Physics has been algebra based, not calculus based, from ~2010 I believe. Unless they've substantially changed the syllabus for the "new" version, you shouldn't NEED anything beyond GCSE Maths (this is in fact the great weakness of A-level Physics imo but, I digress).
However, any degree course that requires A-level Physics also necessarily requires A-level Maths, so there is no point in taking one without the other. Any Engineering course that requires Physics will also require Maths, any Physics course will require both, Chemistry courses will accept chem/phys as two science A-levels sometimes but most strongly prefer or require Maths (Southampton for example has lower offer boundaries for students with Chem/Maths, or Chem/Maths/second science or FM), etc, etc.
Unless you're a prospective medic/natural sciences (at Cambridge and/or elsewhere) applicant who wants to take 4 science A-levels, but doesn't want to take Further Maths it's pointless (I'd argue it's also pointless in that circumstance but to each their own).
So it's not really a question of can you but more a question of why would you take it without Maths. A random science subject doesn't really add anything to your A-level profile unless it's Maths or possibly Chemistry; otherwise they are best taken in combination, of at least 2 or ideally 3. You don't add any options taking one, and may limit yourself in other ways if you do just take a random science subject among other "arts" subjects (excepting again, Maths, which is always useful in general for demonstrating quantitative skills, and extremely useful to essential for some things like economics and similar. Chemistry opens options in chemistry and biosciences, some degrees of which may accept you with just the one science, and a handful of medicine courses who only ostensibly require chemistry and may accept other academically rigorous arts subjects such as History - this may not even be the case any more either.).