From what I’ve heard, a big factor is body dysmorphia. Do you look at your chest and think it’d feel more right with boobs on it? Does the idea of facial hair seem like it could never be “you”?
You don’t have to be all man all the time. You can like feminine things. That doesn’t mean you’re actually a woman. There’s plenty of shades of grey.