I think it would almost instantly solve a lot of the issue with the system tbh. Making people not only have to justify their downvotes, but have those justifications be visible means that their bullshit and brigading would be seen and called out/dealt with.