I think you're just annoyed because you're falling for him, and you want to tell him but feel like you can't. And that's probably why you're having the trust issues, because you're scared of losing him.
I don't think you actually want a break, I think you're just trying to distance yourself from him, because you're scared incase he doesn't feel the same way about you, than you feel about him.
But hey, maybe I'm completely wrong.