But 99% accuracy is better than any human alive, so while maybe LLMs won’t be able to substitute critical systems, they might just replace all the people around those systems.
Like, we won’t want an AI as the failsafe for a nuclear plant. But we might prefer an AI as the the “person” in charge of this failsafe.