That’s LLMs, which is what is necessary for Chat-AI (the first “L” in there quite literally stands for Large).
Remove the stuff necessary to process natural human language and those things tend to be way smaller, especially if they’re just trained using the user’s own actions.