Not to defend the social security number system (because it’s terrible for unique identification of individuals and when it was created it wasn’t even intended to be used for that purpose) but you’re not supposed to carry it around with you all the time. It’s supposed to be in a drawer/safe/fireproof bag with the rest of your important documents, and only brought out when you need it.