Nate Silver turned down a chance to appear on "The Daily Show" last fall. He was doing a book tour. That shows how far late-night TV has fallen.