The AI can’t go full nazi. The AI can’t even go half-nazi. AI is a tool and how we use the tool determines the perception of nazism. Let me put it a bit differently. There are no Nazi guns, the MP-40 submachine gun does not stop working when given to a jew. It is a gun developed and used by the Nazis but it doesn’t make the weapon inherently Nazi. We call it a Nazi gun because we associate it with nazism.
We can develop an AI to act more like a Nazi (see the Gab AI prompt that tries to make the AI act more right-wing) and we can prompt AI into saying Nazi shit, but it doesn’t mean the AI itself is inherently Nazi. The responses it gives we can associate with nazism but it’s not like the AI itself is inherently nazi. In the end it’s just a tool. The problem isn’t generative AI, the problem is us. More specifically the problem are the people who want the AI to do Nazi shit. Let’s not blame the tools for our shortcomings.
And to clarify, I don’t think those protections aren’t necessary. They are necessary because we need to protect ourselves from our collective stupidity.