Do your dumbbells have the same thickness throughout the length of the handles? Some have a thicker middle with the aim of being more ergonomic.
Does this cause any problem other than you feel like you shouldn't do it? This might not be worth correcting if you're still able to hit the targeted muscles and make progress over time.