I lived nextdoor to a massive section 8 apartment and never had any problems fwiw. Sucks that you had a hard time but it’s definitely a ymmv thing.
Just because someone is using a voucher doesn’t mean they’re going to attract crime. Where I lived, it was mostly immigrants that were new to the country.