The downside is that my car carries extra weight in the form of this additional hardware.
No it doesn’t. As far as I know FSD doesn’t require additional hardware. It uses the hardware already in the car for other purposes (like lane assist, emergency braking, etc).