I don’t think it was ever actually co-opted. I think people saw some bearded redneck wear it as a cape in a picture above an article a couple times and then the Internet left decided it was a Nazi symbol.
The Confederate flag has a 100% legitimate argument for being a symbol of hate. The Gadsden Flag is a part of our nation’s founding ideal.