I’m in a similar boat. The use case where I really would use it regularly, simming, is hamstrung by two things. One, it’s so damn fiddly and laborious doing settings non stop to make it playable, and two, even if I get the settings right—I start noticing weird crap with my eyes after a couple sessions. Like you end up basically crossing your eyes all the time inside the visor, and I’ll notice fatigue/trouble focusing after using it a lot, what I would imagine it feels like to have a bad prescription or something (don’t personally have glasses).
And as you say, it’s bloody uncomfortable. Something like big screen beyond with good AR/passthrough would go a long way to fixing that I guess.