The problem is that because the hardware is there, a determined person with physical access can change the settings to join a network you don’t control.
Ideally, you can open the TV and remove the wifi modules but I suspect that might be beyond the skills of most TV owners.
Tbh, I stopped owning a TV since college. I watch everything on my computer or phone now.