Well, if you’re saying things everyone agrees with, you probably won’t have problems, and it won’t even come up whether you have the right to speak. Freedom of speech only comes up as a concept when it is in conflict with other interests.
Many legal issues are defined by their extremes. That doesn’t mean they only encompass extremes. Just that it’s the extremes that delineated the actual boundaries.