It can be done. Just don’t cheap out. A USB4-attached NVMe disk will be faster than a run-of-the-mill USB 3.0 flash drive, and that will run circles around some cheap $10 USB 2.0 drive.
Not all flash drives are rated for constant use, so be sure to have a backup plan.