That’s because they’re authoritarians. They are protecting a hierarchy that they believe exists in the world. That’s why they don’t mind if rich white men hurt them. Those people are higher in their hierarchy, so it makes sense to them.
They don’t like it if non-white people or women in general try to subvert this hierarchy. They believe if someone else rises in status they might fall in status. To them it’s “not right”; it’s a moral issue that people should “stay in their place” in the hierarchy.