@Elizabeth3 Thank you for replying, I was hoping that's the angle rather than exclusivity. :)
We both point to the same thing: the self doubt that comes from our surroundings trying to convince us otherwise.
Seems my doubts took it one step further expecting the same from other people with autism. I won't assume exclusion from anyone who uses it, but I think I'll be wary of using it myself due to my initial reaction.