You go to install the debian live install on another usb and point installation to the desired usb? I think that should do it and you will have a persistent debian install.
If you are planning to use this for the long term there maybe a few better options, because the usb will die very quickly if you use it to run your os.
Use an external ssd, you can get a case for m.2 ssd use that with a m.2 ssd. They are the most compact after a usb drive.
Use external HDD, while slower it’s also an option.
WSL? This is something.
Assuming by drivers you mean drive, backup all data on your drive, format drive, ensure drive no longer encrypted, install windows and Linux.