The only "white people" who are scared are those who read The Sun because it has lots of pictures in it, live in council estates like a tribe and are generally uncouth. These people are the underclasses.
They also happen to be "lazy and stupid".
These people, when the migrants come in, face an existential crisis for migrants are generally willing to work all manner of jobs, all manner of hours, and live in a manner which one would not even remotely deem as "civilized", but they work extremely hard to improve themselves.
The underclass white trash council estate person, who revel in being the most obnoxious of society, are also immensely proud at being at the bottom of the **** pile. However, when the migrants come in, they will be immediately catapulted into a degree above the underclass white trash council estate person and for the people who are displaced, this is an unacceptable and intolerable situation, for even though they may be the lowest of the low, their racial bias, prejudice and superiority cannot accept any "brown person" as being superior to them, so they resort to fighting it how they know how, with tribal warfare.
Hence, this narrative, rhetoric and hyperbole about "migrants stealing our jobs, housing and women" are primarily espoused, circulated and reiterated by those who desire to be regarded as the lowest of the low, but above that of any "brown foreigner".