Unfortunately I can't give a guy's perspective on it, but what I do know, is that when it's a case of wanting a partner to come, it's often a very different perspective from male to female. From what I can deduce, guys expect to have to take time to make a girl come, whereas we girls tend to see making a guy come as a fast 30 second flick of the wrist affair.
But, you have to remember that firstly, everyone is different. One of my previous boyfriends enjoyed the feeling of receiving head much more than having sex, though found it much much harder to come if getting head. Most guys will see it as a negative thing to come fast, and would want to try and hold off to prolong the feeling of being so turned on. So don't berate yourself if he's taking his time. However, I do relate, as there's always a feeling of pride and accomplishment if you are able to make your man come in 20 seconds. So what I'd suggest is to play games, such that, he has to tell you exactly what to do: as if you were a robot, to maximise his pleasure. As if he doesn't make it happen, he doesn't get to come. Once you've ascertained what it is that 'does it' for him at different stages of him being turned on, you'll be able to vary your routine a bit.
We all have our buttons, you just need to play around to find them