That isn’t actually what’s important. It’s the frequency of the token, which could be as simple as single characters. The frequency of those is certainly not zero.
LLMs absolutely can make up new words, word combinations, or sentences.
That’s not to say chatgpt can actually give you good windows keys, but it isn’t a fundamental limitation of LLMs.