Well first off, being a man is not an immutable characteristic, because transgender people exist.
The aspect of being a man that makes people consider you a threat by default is an immutable characteristic though, if you are a trans woman people will treat you that way even more than otherwise.