I guess you’re welcome to that opinion. Just as one would be welcome to the opinion that literally stalking someone should be legal.
Many kinds of speech are very broadly considered okay to restrict, even in places like the USA where “unlimited free speech” is a big motto. It’s illegal to slander and libel people, for example. That it’s illegal in many cases to verbally harass and abuse as well should be fairly non-contentious.