Well, because as a class they raise the cost of land, meaning that many peoples only option is to rent. And then you have to pay off their mortgage for them.
Note that in the USSR apartments were 5 percent of income. That is what the actual cost of maintaining homes for people is, when you remove all the rent seeking and property speculation.