Yes, that’s sorta why I picked that example. It’s a symbol that’s been used in other contexts and is almost entirely associated with a specific negative use case.
If you see a guy walking around with a swastika arm band, do you really think "oh, look at that man showing pride in his Hindu beliefs”?