As someone who does all three sciences, I don't at all think it is the hardest science, at least - there is a manageable amount of content and as long as you put the work in, you'll flourish! Personally, I find maths easier than physics, but that's only because maths has nothing/very, very little to memorise as it's mostly skill whereas physics has theory as well, but that's a given.