I'm not going to say no guy will care, we all have preferences regarding looks. Some guys will prefer small, perky boobs. Other will prefer bigger breasts even if they sag a bit. Large breasts will sag - they would have done so to an extent even if you didn't lose the weight. If we compare them to fake breasts (as I believe you have, since you considered surgery), there is no way you can win. Natural breasts simply aren't big and perky at the same time.
Either way, you're not at disadvantage in any way.