I tried single gpu passthrough. In theory it should work that with some settings you unload the driver and give it to the vm and then back.
However I couldn’t get working without ending on the login screen and starting a new session. So there waw no point for me if I can’t keep my software running.