Depends on the installer. Windows has been pushing the .MSI installer format which is managed to some extent by a centralized system install manager, meaning the system should be able to revert the changes without any custom uninstaller. Installers can still bypass it to some degree though, and it has an option to run a custom .exe on uninstall, but there is also a special cleanup tool (you have to download it separately from Windows support forums) that can “force remove” all the stuff installed by the .MSI.
But otherwise it’s like asking “can’t you uninstall a .deb without running a custom uninstaller script included in the .deb?”…