Yeah. You could try making a symlink from the removable drive downloading folder to your fast drive but I don’t know if that can cause any issues with removable drives, or what would happen if you ran out of space on the removable drive.
Another option would be to use the steam mover app to move games back and forth from your fast/removable drives and get rid of the steam-controlled library that’s located there on the slow drive…