That’s his point I think, if I recall correctly, Zuck was taking it seriously and training while Musk backed out the first moment he could and was basically just doing a publicity stunt.
That’s what he doesn’t want to go through again, not the fight.