txbyc is correct, it sounds to me as though you haven't really reached a good enough standard yet. You should not be overly concerned about rolling back if you're test-ready; has your instructor done clutch control exercises on a hill with you?
And yes, if drivers are overtaking you in tight space this is a clear sign of frustration at being held up by a needlessly slow driver, another sign that you're not ready for test.
I have 40 years experience as an instructor and driving examiner, and I never cease to be amazed about how many poor quality intructors (cowboys) there are out there. Perhaps it's time you sought another ADI to compare?