Right? Way too often, I see some really interesting comments sitting at 0 or -1, and some still somewhat interesting and/ or arguably good-faith comments have something like -50 because they go against the current direction of the herd. I usually upvote at least the former, but for the latter, it’s not going to matter much, unfortunately.
Furthermore, some mods get way too personally invested and take an obvious disliking to you so everything you contribute will be pushed to the bottom of the stack anyways.