Yup. And on descriptive grounds, the whole thing falls into a false dichotomy: treating free speech as an all-or-nothing matter, instead treating freedom of speech as a scale. And that giving someone complete freedom of speech always means restricting the freedom of speech of someone else.
(I typically exemplify this through a guy with a megaphone in an offline plaza. Telling him to drop off the megaphone reduces his ability to reach willing listeners, thus his freedom of speech; but if you leave him alone nobody else can be heard, so their freedom of speech is lowered.)