dojan , 11 months ago

Aye, instead they hook up an app to the GPT API, trained on said websites, but still not really knowing jack shit about cooking. Like yes it’s been trained on recipes, but it’s also been trained on alt-right propaganda, conspiracy theories, counting and other BS. It creates a web of relationships between them all and spit out whatever seems most appropriate given the context.

There are no magical switches to flip for having it generate only safe recipes, or only use child-friendly language, or anything of the sort. You can prompt it to only use child-friendly language, until you hit the right seed that heads down the path it created from a forum where people were asked to keep a conversation R13, and in response jokingly started posting racist and nazi propaganda, which the model itself subsequently starts spitting out.

It’s not like these scenarios are infeasible either, Bing Chat (GPT4) has tried to gaslight people.

Sure, your suicide-hotline chatbot might be super sweet and helpful 99.9% of the time, but what about that 0.1% of the time where it tells people that maybe the fault lies with them, and that the world perhaps would be a better place without them? Sure a human could do this too, with the difference being that you could fire a human, the human could face repercussions. When it’s a LLM doing it, where does the blame lie?