You're technically not allowed to wear it until you actually graduate. Until then you just carry it.
Mortarboards are more common, but some people do wear the soft caps. Once you've got all the excess starch out of them, and if you wear them on the back of your head rather than on the top, they look much less stupid.