Key word being history. Slavery was entrenched in the history of society and we successfully separated the two (although society still needs to work on the second order effects, sadly). Just saying it’s been that way in the past is not a valid argument for why it should continue. That’s basically an appeal to tradition fallacy.