I think they should kill off both the $100 bill and all change under $1. Having only $1, $5, $10, and $20 would simplify wallets, reduce corruption, and encourage people to use more secure payment methods like credit and checks.
It would also give a contemporary purpose to post offices, that are sending less and less mail.
If the rates were good, I would definitely consider opening an account at the Post Office -- if only for the nation-wide convenience of being to visit a Post Office in any town in America.