A lot of fishers don't actually kill the fish, but simply put them back in the water.
I also disagree, fox hunting involves foxes being hunted for hours, and most likely being ripped apart by dogs. Fishing is comparatively very tame.
If you'd like, we'll ban every animal from killing each other for food too?