I think you hit the nail on the head, but personally, I stopped upvoting “to help the community” a while ago. Lemmy seems to be doing fine now so I’m not against downvoting at all either.
The people upvoting those crappy 15 year old memes aren’t against downvoting either, because when I mentioned how terrible the memes were I got downvoted.