Exactly. If you have the means at hand, you have the responsibility to act. At the risk of taking a shitpost way too seriously, if you were in that situation and actively chose to leave the decision to someone else to kill double the people, then you acted unethically.