All of it leads back to zoning laws preventing more housing being built, and of the correct types. Most of that is caused by NIMBY types worried about the character of the neighborhood, and perhaps a bit of bigotry. It IS supply and demand, and short supply is caused by bad policymaking that nobody really benefits from.