As a woman, who is into men, and has friends who are also into men. Everyone I know who is into men would say Hiddleston is more attractive than any of them.
When we say buff men are there for the male gaze what we’re saying is that they’re filling a male power fantasy of being the “big strong hero” archetype. You’ll also notice that all of them were depicted as being complex characters in their own right, absent of just being big and buff.