That’s not the only issue, fat32 also has a hard limit on single file size. The largest a single file can be is 4GiB, and afaik you just can’t get around that with fat.
iirc, the way windows deals with this in its media creation tool is that it strips out locales and other things you don’t need, based on the options you selected previously, so the file ends up being small enough to fit.