I hear you, and maybe I am too critical. It never had the love for me post Stewart though, and I watched it pretty much every day for many years. Including the entire Oliver stretch. I dropped it pretty early during Noah because it just didn't catch me at all, and in spite of several tries I never was into it again. Even Al Fraken's stint didn't capture me. Bee was great though.
I think this may speak more to the state of talk series than anything else -- most of them are just so bad these days. ...how on god's green earth is Bill Maher still consistently one of the top-streamed shows on HBO I will never understand.