Main reason is that many apps have a separate CarPlay or Android Auto UI that is less distracting, more glanceable, etc.
It’s kind of hard to go back once you’ve lived with it for a a bit. It’s much more convenient. A simple phone mount feels kind of janky and distracting afterwords.