CSA states’ declarations of secession, if I remember correctly, used the word “slaveholding” rather often to characterize CSA’s members.
There are some other differences in direction, so back then it really was to some extent about states’ rights, just as important as slavery or maybe a bit less. Which doesn’t change the point.
(Also - I was a stupid kid at some point with sympathies to confederates. Eh.)