Sometimes the different USB ports are backed by different manufacturers. Pretty much all of my USB outputs are a bit unreliable. Apparently a hardware issue. There are two that use a different chipset. Those are the only reliable ones.
So maybe check the various USB ports to see if there’s a difference.