I don't have a solution, but an idea just came to me.
For every non-primary residence someone/some company owns, add a tax that goes to a fund. That fund is then used to purchase land, build and maintain 1-4 bedroom housing, and provide utilities/services.
Anyone should have access to this housing, but it must be lived in or you lose that access. Each state should implement it so Texas doesn't just send everyone to Oregon.