I’m fairly certain something like that has already happened with Canadian Airlines. A person asked about bereavement travel and the AI chat bot claimed one thing and the company refused to honor it. IIRC, the court said the company had to abide by what the chatbot said.