Yeah. I mean the fundamental issue is: ChatGPT isn't human. It just mimics things. That's the way it generates text, audio and images. And it's also the way it handles "empathy". It mimicks what it's learned from human interactions during training.
But in the end: Does it really matter where it comes from and why? I mean the goal of a venture is to produce or achieve something. And that isn't measured in where it comes from. But in actual output. I don't want to speculate too much. But despite not having real empathy, it could theoretically achieve the same thing by faking it well enough. And that has been proven in some narrow tasks already. We have customer satisfaction rates. And quite some people saying it helps them with different things. We need to measure that and do some more studies of what's the actual outcome of replacing something with AI. It could very well be that our perspective is wrong.
And with that said: I tried roleplaying with AI. It seems to have some theory of mind. Not really of course. But it get's what I'm hinting at. The desires and behaviour of characters. And so on. Lot's of models are very agreeable. Some can role play conflict. I think the current capabilities of these kinds of AI are enough to fake some things well enough to get somewhere and be actually useful. I don't say it has or hasn't people skills. I think it's somewhere on the spectrum between the two. I can't really tell where because I havent yet read any research considering this context.
And of course there is a big difference between everyday tasks and handling a situation that went completely haywire. We have to factor that in. But in reality there are ways to handle that. For example AI and humans could split up the tasks amongst them. And things can get escalated and humans make difficult decisions. But that could already mean 80% of the labor gets replaced.