Part of the problem is that the main anti-Disney political coalition doesn’t want to address the local housing crisis; they want the region to go back to being a suburban sprawl.
You could easily build dense housing in the area that meets the balloon test, but Disney doesn’t want to push it and the anti-coalition doesn’t want it either.