If you google "Cambridge Part II Astrophyiscs" and find the past papers, you'll quickly realise that Astrophysics is even more mathematical than a more general Theoretical Physics course
Well, that's not even all the maths you think you need. Check out more here. To be honest, one of the beauties of physics/theoretical physics lies in the exact mathematical solutions.