Not in Retroshare or Freenet or I2P. They do have such people, of course.
My free speech absolutism would be in separating community moderation from actual physical instances.
Say, a P2P system where you subscribe to a community (somehow identified) and the “deleted” comments and “banned” users are that because of there being a “delete” record signed by that community.
With distributed storage, but storage a user contributes being used only by communities they subscribe to, so not like Freenet with every user probably storing one or two blocks of CP files.
EDIT: That would allow everyone to verify moderators’ honesty and fairness, which would be beneficial to moderators themselves, but at the same time in practice you’d have easy moderation.