With that said, students often find they have time for a part time job at university, so depending on how you feel about it, you might want to try to carry on working for several hours per week to earn some extra money to support your studies. A full time job alongside a full-time degree would almost certainly be too much for any subject.
Which specific course and university are you asking about? There are typically several different courses which vary a great deal in terms of how much programming, maths and CompSci theory are involved - also, their overall difficulty and pace is highly variable depending upon which university you're going to (Obviously top universities will be a lot harder and ask you to do a lot more work than some of the less prestigious universities). To find out any useful answers to your question, the best thing would be to try to find out specific information about the actual course/university you're applying to.
In general, programming itself (As a skill, rather than as a course) doesn't need any you to understand any complex maths, although maths is a rather natural subject to study alongside any computing related subject because Computer Science itself has its origins rooted in mathematics. With that said, university courses usually are a lot broader than just "programming" - they're usually focused on a wider discipline such as Computer Science, Web Development, Game Development, Software Engineering, etc.
Computer Programming ultimately boils down to problem solving and critical thinking about problems. There are of course a lot of tools and specific technical skills involved (particularly the skill of being able to write code using one or more programming languages, and being able to 'think' algorithmically about solutions), although computer programming usually feeds into a broader subject area known as Software Engineering, which is a discipline all about designing, creating and maintaining software.
If you want to give yourself an introduction on programming before you start university to find out whether it might be something you'd enjoy, and discover whether it's something you find easy/difficult, then try spending some time taking these online Python lessons - https://www.codecademy.com/learn/learn-python - Python is a widely used programming language often considered to be a good 'starting language' by schools/colleges/universities for helping students learn about programming and computational thinking.
You could also check out this Harvard course which is aimed at learning programming and computatinal thinking too:
If you just want to learn to program, then there are innumerable resources on the web which you can use to start off. A degree is not really necessary for this, and you may find an apprenticeship or other vocational programme more suitable to your interest. Degrees are necessarily academic, and CS is definitely as academic as any other field.