Yeah, you can’t really say “we started the engines but #2 wouldn’t start, so we’re continuing to the destination on one engine”. Delaying/cancelling the flight due to a safety/maintenance issue is perfectly legitimate.
The issue is that after that, a) passengers are entitled to compensation depending on the delay, and b) you need to provide food/water/aircon or take the passengers back to the terminal.