Part of it is the fact that the more right-wing instances end up full of nasty hateful shit which results in everybody else defederating from them - just look at Exploding Heads where two of the posts on their front page are “I absolutely hate fat people” and “I support Trump because if he wins there will be mass suicides”; not exactly the kind of content most users want to engage with!