Depends, I guess. I feel that our capacity to be horrible outweighs our ability to handle it well.
The movie’s AI is a fully present consciousness that exerts its own willpower. The movie also doesn’t have microtransactions, subscriptions, or as far as I can tell, even a cost to buy the AI.
That seems fine. Sweet, even.
But I think the first hurdle is whether or not an AI is more a partner than base sexual entertainment. And next (especially under capitalism), are those capable of harnessing the resources to create a general AI also willing to release it for free, or would interaction be transactional?
If it’s transactional, then there’s intent - was it built for love, or was that part an accident? If it was built for love and there’s transactions, there’s easy potential for abuse. (Although abusive to which party, I couldn’t say.)
And if, say, the AI springs forth from a FOSS project, who makes sure things stay “on the level” when folks tweak the dataset?
A personalized set of training data from a now-deceased spouse is very different than hacked social media data, or other types of tweaks bad actors could make.