The vast majority of the population were slaves, who had to be well-muscled to lift heavy stones to build all those beaux-arts star forts of the Tartarian Empire. Then there were the barbarian warriors, who needed the musculature to effectively wield a zweihänder. If you saw a skinny dude, chances are he was an evil wizard.