If you are US based, I think there is something like registering for DMCA take-down requests, so that they will contact you first for removal but IANAL.
But it is pretty much FUD that the Feds will come to your door on the first minor issue. If you react quickly to any complaints they will probably not bother.