I had a similar thought after I wrote this. LLMs aren’t creating anything so much as style-copying. They’re unique productions, insomuch as rearranging notes or pixels makes something unique, but I think creativity requires conscious agency, which LLMs definitely do not have.
Also, I don’t need to copy the entirety of Drake’s discography to produce music like his, which is an aspect of human creativity that LLMs currently lack.