Yale has a top 5 rowing team. Schools like that are highly ranked in "preppy" sports like squash. Its American football team is like 300th ranked, so you need to be good for them to want you for rowing.
Anyway, you should apply to several US schools and not focus on one.
...or just paranoid?