I think the context really matters. If you start a convo with someone who was already gaming, its less weird. But if your sitting on the couch with a loved one and mid convo they start gaming (or looking at a screen), its a lot more antisocial.
I personally don’t get the point of this product though, it feels to me like Apple making the same mistake as Google Glass, but I guess time will tell if this really takes off.