“It has already started to be a problem with the current LLMs that have exhausted most easily reached sources of content on the internet and are now feeding off LLM-generated content, which has resulted in a sharp drop in quality.”
Do you have any sources to back that claim? LLMs are rising in quality, not dropping, afaik.