You can use federated SSO. The remote site never sees your credentials but only a token that you’ve been authenticated against your home instance.
That being said, that’s probably the problem, in order to do federation a small degree of trust is required between the two instances. I guess that is already done with activityPub since you’re getting content from remote instances.