Your decision is a personal one and depends on your interests, career goals, and academic capabilities. I would advice you to consider which subject you are more passionate about. If you have a strong interest in psychology and enjoy studying it, you may want to keep it in your academic pursuits. Consequently, ensure that the choice aligns with your long term career goals if you have a specific career path.