I’m pretty sure the intent when upvotes and downvotes were created was to use them in regards to relevance. Is the topic about ducks and someone is going off about jeeps? Downvote. Is the community about posting DIY peanut butter but someone keeps posting Skippy™? Downvote.
It shouldn’t have anything to do with agreeing, effort, or anything like that. Just a way to keep the topic/community on track.