I think being on lemmy does not in any way oblige a user to listen to everyone all the time. A lot of people will just come here for a good time. And for the freedom of speech activists: freedom of speech also involves other peoples freedom not to want to listen.
Moreover, I think most people who want to defederate with certain instances don’t necessarily have a problem with different world views, but have a problem with the tone being set by a small percentage of the users of said instances. Unfortunately, only a small percentage is needed to create a general vibe.
I hope it will be possible for individual users to block entire instances very soon, this way this whole debate will become obsolete. Personally, I can’t wait for it (the debate to become obsolete, not blocking instances necessarily)