While the XY problem sort of applies to this post, I think labeling it as such might be a little too dismissive, since this is one of those rare cases where OP has correctly identified the root cause of the observed issue.
(Easier workarounds exist, but the ideal solution would indeed be fixing the hardware manager’s input idle detection such that it no longer ignores game controllers.)