KevonLooney , 20 hours ago

It’s not just a predictive text program. That’s been around for decades. That’s a common misconception.

As I understand it, it uses statistics from the whole text to create new text. It would be very rare to output “cats have feathers” because that phrase doesn’t ever appear in the training data. Both words “have feathers” never follow “cats”.