I stopped using Android Auto on my infotainment system. I thought it was just me but when I’m using navigation (Google maps or wyze), the second I lose service for any reason, it completely exits out and cancels my navigation. I found that if I use it in my phone, it doesn’t have that issue.
2020 Subaru Forester, but friends with other cars (VW, Honda) mentioned the same issue. Not sure if this has been fixes in recent Android Auto updates or in newer cars, but I’m not going to chance it anymore.