I think people would be surprised at how little hard drive space some models take up when you compare it to what they can produce. You can store LLMs on your phone. Cat’s out of the bag.
And despite any restrictions we try to make, there will be a company with great GPUs or TPUs that will be able to fine tune giant models without anyone knowing.