It gets tricky, though. For example, what if the AI was trained on recordings of voice impersonators (with consent)? We may be limited to banning companies from promoting the AI voices as being specific people…
Years ago, Moes Southwest had a problem like this. Their decor featured images of artists, but it turned out they did not have the rights and were sued. So they ran a celebrity look alike competition and used photos of the winning look alikes instead.