While what you’re saying comes from the right place, it can also be dangerous. That attitude/idea can lead to blaming the marginalized group for their own victimhood.
I do think it’s more common for gay than trans, and sometimes has a grain of truth. But much of the time people are just assholes looking for someone to bully and hate.