To extend this, consider your own safety throughout. Unless the police arrest them and they remain in custody, you have a potential serious threat. Avoid situations where you/others could be vulnerable, such as alone or at night. You may want to setup visible surveillance cameras, alter your routines, etc.
The police will be there after anything happens, but that may be too late for you.