The difference is a random IP is a random IP. You don’t know who it’s connected to. Once some says “This is my IP” you now have it connected to a specific person, and other specific people may want to fuck with the original person.
Bots already scan all open IP addresses for vulnerabilities, but hackers live for people who give up information for free.