It’s about personal preference for sure. I tried to start using the “white” emojis and it just didn’t seem to matter. If I do use an emoji, I tend to default to the Simpsons yellow because it requires no extra effort. I don’t see a ton of people using the skin-tone emojis at all. I also have no issue with people using them much like pronouns in emails/profiles.
I’m also on iPhone so if I am going to extra mile I’ll just use my little sticker guy who better represents me in general.