Do you get what’s the point of decentralized social media
Do you?
It certainly doesn't mean "everything from everywhere can reside on the server I pay for". Nor does it mean "we can't vote them off the island if they're negatively impacting us".
It means exactly the opposite, in fact. It means we get to say "no" at whatever level we choose, and that includes at the server level.
If you don't like the choices the admins on your server make, find a new one, or start your own. That is the promise of federation.