I think someone on Slashdot was explaining that in actuality, the next guy becomes President at noon regardless of whether he takes the oath or not. Which makes sense, that it'd be more of a formality, especially if there was a war or something and everyone was busy with crazy stuff.