So he was a builder, then he maintained the building. Both of those involve labour and doing things.
Now, if as a landlord he only collects rent and does nothing else, then that’s why it’s not a job, it’s an investment. Same as if you own shares in a company.
If he still maintains the building, then that’s still labour, but the work is the maintenance, not the landlording.