We will be economically worse off leaving the EU. With a deal, the harm can be minimised, without one it will be worse. It will not be people on six figure sums a year that will suffer, it will be those on low incomes.
If we had been as good at negotiating as the EU and actually knew what we wanted, then perhaps a reasonable deal could have been achieved.