I think that in the future generative A.I. will be seen like the Turbo Button, Desktop Publishing Revolution and Information Superhighway of their day, ideas that over promised, under delivered and faded into obscurity. I suspect that Block Chain and Crypto Currencies will go the same way for similar reasons as outlined below.
Machine Learning is a useful tool to automatically generate a model for a multivariate system where traditional modelling is too complex or time consuming.
Generative models are attempting to take that to a whole new level but I don’t believe that it’s either sustainable nor living up to the hype generated by breathless reporting by ignorant journalists who cannot distinguish advanced technology from magic.
It’s not sustainable for a range of reasons. The most obvious is that the process universally disintegrates when it ingests content generated by the same process.
Furthermore, it doesn’t learn, specifically, the model doesn’t change until a new version is released, so it doesn’t gather new models whilst it’s being used.
And finally, it requires obscene amounts of energy to actually work and with the exponential growth of models, this is only going to get worse.
Source: I’m an ICT professional with 40 years experience