For signing, it’s backwards - you encrypt with the private key, and then everyone else can decrypt with the public key. If that doesn’t work, they know that the message wasn’t signed by the private key paired with the public key they have, and therefore is invalid and is not to be trusted.
Signing proves authenticity (only the private key holder can sign), encryption provides privacy (only the private key holder can read)