God, no. Voting as a filter is soft moderation, and moderation is crucial.
Voting on a comment isn’t sending someone to the cornfield. You can downvote a dumb post and upvote a good post from the same rando within the same minute. You might not even notice unless you pay attention to usernames.
Every system is perfectly designed to produce its observed outcomes. Reddit, for all its many, many flaws, is probably the closest humanity has come to “the free marketplace of ideas” actually working as-advertised. Frauds and fascists had to retreat to their own miserable boltholes… until they started crying to the moderators that every detailed disproof of their entire worldview came with G-rated insults. Was their insular and irrational behavior besides that? Yeah, of course, it’s a mass of humans. We suck in predictable ways. But on average we can make things work. All that’s usually necessary is that decent people are allowed to help.