Yes, there are some limitations to be aware of, with how it interacts with certain features. But EXT4 doesn’t have any of those features at all. It doesn’t have CoW, or balance, or multi-device, or snapshots.
If the filesystem, is single-device, and you have the swapfile on it’s own nocow subvolume, preallocate the swapfile, and don’t try to take snapshots of it, it should be fine.