Mine did that, but I just pushed it through again.
With mine, you have to get your finger up into your nose and feel for the stud as it comes through the front of the hole, then wiggle your finger around a bit until it pops through.
It's probably too late now, but I was sat in front of the mirror for around 2 hours trying to get it back in again - and was successful. Don't give up.