Tolerance is a social contract, not an ideal. If someone refuses to adhere to the contract, then they are not entitled to the benefits of it either. Hence, there is no paradox. When we say “be tolerant to all” what we mean is “please adhere to the social contract, and assume everyone else does so, until proven otherwise”.