There issue then is that you’re likely to end up with a SCOTUS that always agrees with the ruling party.
My proposal would be to retire the longest-serving justice each time there is a presidential election, then use the national popular vote to decide which party gets to select his replacement.