Honestly it’s a problem with binary ranking systems across the board. Maybe if there were additional axes you could vote on, like “agree/disagree”, “quality/low effort”, “nuanced/trite”, etc. I don’t know how one would go about implementing such a thing, but until someone does, we’re stuck with having a simplistic system that doesn’t adequately reflect the complicated responses real people have to content.