Having worked for both a Big 4 in consulting and in an investment bank, it ultimately boils down to working in a fairly process driven environment at the same desk every day against working for a number of clients on various projects. Having said that, salaries in industry will be higher, plus not everyone might want to travel as much as consultants do.
Also, another issue which may get overlooked, is that unless you work in a front office position in an investment bank there will always be a gap between the traders/bankers and finance ("middle office") people, whereas if you work in a Big 4 in an audit role or as a consultant, effectively you are the "front office" (as you provide services directly to the client), though then again no client likes auditors ;p Therefore if you do decide to do a finance/risk/compliance role in a bank, you will occasionally feel like sh*t around front office people as they look down at you; it can be quite evident in their attitudes.