That’s only true if you think the colonized being exterminated and the colonizers doing the exterminating are equally bad for fighting. One side holds all the power, and that’s the side you default your moral alignment to because you are either a settler, or you benefit from settler colonialism.