I feel the same way about biometrics. When I tell friends, family, and coworkers about this, they look at me like I’m crazy. You can change your password. You can’t change your retinal pattern, fingerprint, etc.
And I don’t care how much someone tries to convince me on how securely it’s stored inside the phone hardware or the cloud. You are trusting every single coder and engineer who has a hand in designing and maintaining these things. Not to mention hackers who always find a way to breach.