By all accounts the past couple seasons he just shows up drunk to record his lines, be obnoxious in the office for a couple hours and then go home.
The actual writing and content hasn’t really involved him. So assuming they can find a voice that isn’t too jarring, odds are the average person won’t know or care and the show will be just fine.