Please take the time to read this, I think it may help...
I was talking to a friend of mine and his cousin finished school at 18 and worked at Game for two years. Eventually he decided (when he was about your age) to pursue a degree in Physics (and maths, joint, I believe) through the Open University.
After that, he went on to do a teaching qualification and even trained at the school I was a pupil of at the time (all the while still reading his subjects as an academic would). I think he eventually gained something amazing like 2 BScs and a Masters in Mathematics (all 1sts aswell).
He then did a PhD while working at one of the TOP Grammar Schools in my area as a Mathematics and Physics teacher.
He is now in contension for a Fellowship in the Maths Dept at the Univeristy of Warwick (which happens to be the best Maths research university in the UK).
So now he's looking at a £70k+ salary per year and all he's done is what he loves; studying and teaching! (I appreciate that I probably sound like one of those "Make £290 a day from home" adverts, but it is true)
The point I am making is that you are NEVER too old to start afresh and, if you put your mind to it, you can achieve your dreams (without sounding too corny). It takes absolute dedication and drive, but if you are as passionate as you say you are, you will do it.
(He also didn't have to move away at any point, so you would be fine to stick with your partner
)