Well being homeless isn't safe either, and while it'd be much nicer if no one was homeless, they are, and they deserve the same level not only of safety, but also autonomy.
I bet you've never bothered piping up about guns not being safe when housed people are being discussed, that's what you should be focused on, not your paternalistic urge to control what others you feel superior to, do.