Im in the almost exact situation as you, the career prospects for psychology are really quite dull and im considering changing to economics too despite having no A level in maths or economics. But if you detest maths that much then it'd definitely be an issue studying economics at degree level as it entails quite alot of maths, so stick with psychology and as you enjoy the neuroscience aspect of it try get as much experience as you can during your weekends, holidays or whatever. It'll all add up and will make you stand out more to employers