I mean the reality was that the time “off” was spent farming their own land, taking care of animals, fixing the house and doing the insane number of household tasks that come with premodern living. Spend a few days just cooking in a medieval style, and you’ll quickly realize it’s a LOT of work.