I think you’re right about work, having a 9-5 means you have a reason to get up in the morning, and tends to get you into the habit of getting up at a similar time on the weekend as well.
Personally, I think having nothing to do is worse for your mental health than anything else.