One of my close friends put herself in exactly the same situation as you, i.e he used to withdraw at the critical moment, and , yes, you've guessed it, she did fall pregnant.
It was a disaster to her (and for info, she did have the baby, no partner around now, but highly supportive mum and dad lucckily for her)
So DO NOT TAKE THE RISK