Poor whites may have been poor, but they sure as Hell weren’t in danger of being arrested for “vagrancy” for being unemployed and then worked to death in a convict-leasing scheme the way black people were.
(Or, getting back to the specific topic of this thread, having their neighborhood firebombed for being too “uppity” whenever they did actually manage to succeed.)