This isn't about safety - those places are safe to live most of the time, and the weather predictions are very good at giving you a week notice to get out before the exceptions.
It is just too expensive to have buildings in those areas. Nobody builds a house that can be moved away from those areas in a week. Thus if you live there you need to account for the costs of rebuilding your house every few years when the weather destroys it. Or you need to build a house that can survive the weather - I don't know how expensive that would be.
I don't care if you want to live in those places, but I do not want to subsidize your housing if you choose to live there. Come move closer to me if you don't like it. (note that there are other risks living close to me)