They used bulk concrete and well fitted stone. Bulk concrete doesn’t really decay but is hard to build with, so we typically reinforce it with rebar. Rebar makes concrete much stronger and less brittle, but it also corrodes, and when the rebar fails, so does the reinforced concrete.
We could build things like the Romans did, but it would be more limited and expensive.