Yes, the liberals generally aligned with the fascists against the antifascist left. This consolidation of power did happen because of the material conditions in Weimar Germany, you are absolutely correct. However, that does not mean killing Hitler would have been worthless.
History does not move by Great Man Theory, we agree on this. At the same time, fighting Nazi leaders does harm the Nazi movement.