It is very weaselly, but I gotta also note that this language is directly answering ethical obligations for judges.
Judges must not only avoid impropriety but also the appearance of impropriety (the judicial branch is only as strong as the will for people to believe in it. If a judge harms the confidence in this branch, they need to be removed).
So what he’s saying here is that it doesn’t matter if it’s impropriety or appearance of impropriety, he has an obligation to step down.
Like I said, very slimy, but he’s not just doing politicical rhetoric, he’s directly addressing his ethical obligations.