Dropping an A Level (4 to 3)

I'm currently doing Maths and 3 sciences, I'm eager to drop Physics to make the workload much easier to handle and also because universities only require 3 A Levels. My school does internal exams (so we don't sit the AS qualification meaning we don't get UCAS points I think), meaning there would be no point to continue doing Physics and then sit a mock exam at the end of Year 12.
What do you guys think?

If you wont get the AS and don't need physics for what you want to do at university then yes drop it now

Thanks for the advice!
and sorry, I should've stated that I want to study Medicine.