The overhead of additional instructions isn’t the issue, they often translate those instructions into a smaller set of actual operations. It’s not like they have a special circuit for every instruction, a lot of instructions translate to a pipeline of multiple, modular circuits.
The actual silicon will look more like ARM despite having a very large difference in instruction set sizes.