These days “free speech absolutist” is used more as an excuse to defend hate speech than actual opposition of censorship. Elon was always inclined to censor whoever he finds inconvenient (company whistleblowers, plane tracker), and many of his fans are similarly inclined, say, against LGBT people, socialists, and other groups they dislike.