Don't worry about what you want to do in the future. It's pretty common for people to do degrees but not necessarily want to work in that field.
Chemical Engineering is generally a great degree and you can definitely get employed into a variety of jobs in and out of the engineering sector although, you have 3 - 4 years to decide on what kind of job you want seeing as you haven't even started your degree yet so probably don't worry about it too much.
Since you "LOVE" Maths and Chemistry I think you will probably like the course a lot since it is a really maths heavy course.
As for you not taking physics generally, people say there's not a whole lot of physics or the only physics you use in first year is from mechanics modules in A level maths. I posted a similar post about not taking physics A level if you can find it which you might find helpful.