Chemistry is great, my favourite subject (from Bio, Maths, Chem AS Phys, F.Maths).
I would recommend it. The workload is fairly small if you are good at learning theory. Then it's just a case of applying the same concepts to different situations. There is a fair bit to remember in the organic chapters, but overall, it's more about applying knowledge rather than memorising. I found it one of the easiest of my A levels and had very little work to do up until the final A2 papers. It was mostly a breeze.
I dont know about comparing it to maths, that's like comparing apples and oranges. Who knows? What I do know is you should pick subjects based on what you enjoy and are good at, not based on 'perception' of difficult-- it's just a perception and usually shows the general population's weakness rather than what you are capable of.