It's not too late to drop geography for physics, and I strongly recommend doing the A Level whilst you are still in college because it can cost at least £1250 in exam and admin fees for a science A Level with practical assessment outside of college.
With physics degrees in general, they usually prefer A Levels and IBs over anything else. It's very rare that you would find a uni that would accept any other qualification, so in your case it's more or less A Levels or foundation years.
Foundation years generally restrict you to the universities that you can apply for to my knowledge i.e. once completing a foundation year at one uni it's not likely that you can be immediately transferred to another uni, because they would require to check you have covered the required material in the foundation year. It's much easier with A Levels.
Having said that, if you did a foundation year at a specific uni, it's not that difficult to switch from one subject (say physics) to another (say engineering) within the same uni or department.
To my knowledge, you would still need to cover statistics even for a physics degree - experimental physicists would need to run stat tests to analyse data for their experiments, so you're not out of the woods yet.
On the other hand, if you want to do a degree in mathematical physics (which is essentially a maths degree in a physics context, or mostly mechanics), you should be able to get away without doing anything related to stats. You would need to check on this.
Should you wish to do a degree that cover both subjects, consider Natural Sciences and pick Maths and Physics specialisms or pick a joint degree in maths and physics. In these cases, you should still need to cover stats for the physics modules.
A number of maths degrees will require you to cover stats, even if they do say it's a degree in Pure Maths.
To my knowledge, there are only a handful of universities in the country that offers a physics degree where you can borderline get away without having A Level Physics:
https://www.lboro.ac.uk/study/undergraduate/courses/physics-bsc/#varianthttps://www.port.ac.uk/study/courses/undergraduate/bsc-mphys-physics#entry_requirementshttps://www.kent.ac.uk/courses/undergraduate/2022/22/physics-bscAt the moment, the websites are filled with information on clearing, so I can't tell what some of the universities' entry requirements are
I am not sure whether Hull require any specific subjects:
https://www.hull.ac.uk/study/undergraduate/physics-bsc-mphys?d=2022&var=standard#entryAs a fun note, you can technically go into geophysics/geology with geography + maths, but it's not the same as a general physics degree. I am not entirely sure whether you can then get into a master's in physics should you decide to pursue it in research with an undergrad in geophysics (generally it's engineering, physics, or maths degrees that are accepted).
If you do want to go into physics research, it's generally recommended that you do a MPhy over a BSc + MSc. Whilst the MSc allows you to study at another university, the tuitiion of the MSc can be significantly more than £9250. I would try to do the MPhy at a top end university where possible.
All in all, I would strongly recommend doing A Level Physics whilst you're still at college, even if it means sitting for another year (unless you want to squeeze an entire A Level in 1 year in your second year of college as a private candidate, which I strongly not recommend you do). If this means dropping geography, then by all means. This would widen the options available to you and allow more flexibility to pick the degree you want to do.