First tar up your filesystem. You can use gzip to save space. Once that’s done copy it over. Make sure you use a good filesystem on the USB device that isn’t going to cause data loss. (ie not fat)
Keep in mind that you can’t do this live and that copying the archive over will take time and the drive may lie to you. Its always best practice to run sync or eject before unplugging.