OP, I'm in my final year doing BSc Geography at University of Manchester.
1.I have no science background whatsoever, I only had Geography, English and French in my Baccalaureate exam.
2.What matters is your personal statement, if you make your case for becoming a physical geographer then you will get in.
3.There have been situations when I wished I had a scientific background. However, these were few and with hard work, everything is fine.
4. Remember that geography at uni is quite different than what you did before and university in itself is a place where you can change dramatically. I'm actually among the best 5 physical geographers in my department.
So do not be afraid, uni life will give you a chance to prove yourself and Geography is one degree where science is needed but not in hardcore way, at least not at this level.
Who do you think it is...