Apparently they’re supposed to have a deputy, but the position has been vacant since 1990, when the current government system was established.
Usually, parliamentary systems will elect a temporary caretaker, but I guess Bangladesh isn’t stable enough for that. Seems they often end up with the military temporarily in control.