I’m not going to support a genocide to stop anything!
Ironically, not even to stop a genocide. You’d rather two genocides happen than try to at least prevent one.
If the trolley is going to run over people regardless, and you have the option afterwards to prevent it from running over more people, the moral option is not abstaining.
Pro lifers who don’t believe in any exceptions believe abortions are genocide as well, and are willing to accept any and all consequence of total bans. There’s a similarity with your thinking, and it’s one you should seriously examine.
Your opinion is your own, as are your beliefs. Just be aware of their consequences and how others may perceive your morality.