Typically the first amendment is going to protect you when you say most things. The types of things you definitely don’t want to say are specific threats.
But there was a sad situation in Colorado where the courts ruled that a guy could be locked up for saying that he wished that bad things fell upon some judges, even though he definitely didn’t say or imply that he was going to do them. So if you want to rely on the Colorado precedent, maybe there’s something to work with, but it’s a pretty terrible precedent.
That all being said, let’s not wish death on anyone. Even if it’s someone who’s done horrible things, let’s just wish that they’re forced to retire early and either get locked up in prison, if they committed crimes, or live out there lives in miserable condition in some community that we never have to visit or think about.