The concept of white privilege is based on the assumption that an inequality of outcome is evidence of discrimination. If there is a quantifiable pay gap between genders, then it must be a result of inequality of opportunities for women. If there is a disparity between economic status of whites and people of color, then it must result from systemic prejudice.
Is it completely impossible that white males are more socially successful for other reasons? What if White males are more statistically successful on average due to their behavior? This could be attributed to cultural or genetic influence.
If this hypothesis has any validity then consider the implication. A high performing white male, who has made positive life choices has his success marginalized by a social justice agenda. He will have to overcome true institutional discrimination such as affirmative action, and cultural diversity mandates. There would be white males who have more qualifications and contribute more, but receive less compensation. That is what social justice is all about.