I totally agree. I used to absolutely love Doctor Who the first 2 seasons, I thought it was amazing. The 3rd season went downhill a little bit, but the 4th season was an improvement over the third, especially due to Catherine Tate's humour, but it wasn't as good as the first 2. Then when Moffat took over and Smith became the new Doctor, it went massively downhill, to the point that I barely think its worth watching.
I love Sci-Fi and Fantasy, but during the Moffat/Smith era Doctor Who just seems so ridiculous, illogical and nonsensical that it irritates me.