Because ignoring them will only allow them to grow larger and stronger unchecked. It’s like talking about ignoring an obvious stalker who is clearly building a plan on your daily movements and knows exactly where you live and when you leave/return home. They can be a remarkably stupid person but they will eventually find the perfect opportunity to strike and you will never be able to get any justice for it.
That is literally something that happened to me. More than once.