Again - timing. Who will really remember when it comes time to vote the bums out. And those that do? Most will fall prey to the it's your guy who sucks, my guy is an angel syndrome and most of the malefactors will retain their seats as always.
There's a saying in political science...(paraphrase)...People hate Congress but love their Congressman.