I would stick with it. Your degree will take up three years of your life. Think of all that time you spent at school learning things you didn't necessarily find interesting. At worst, you'll end up after three years a belligerent soul who curses at chemistry and has an odium for Oxford. And, at best, you'll end up loving the subject because things can change.
But, whatever the outcome, you'll end up with a degree from one of the greatest institutions in the world and, with that, the key to do pretty much what you damn well like!