If they advertise ~12V, it usually means it is 3 'cells' of 18650s in series. Crack open the case on such a tool battery and you'll find just that -- 3 18650 batteries for a little one. A high capacity battery might instead of 6, with 3 pairs of 2 parallel batteries, doubling the capacity. And nothing but weight and size stops them from just making them ever-larger.
18-20v tools are 6 cells (18v is the nominal voltage, 20v is the 'max' voltage at full charge). For higher cap, add more batteries in parallel in each series cell.
It is RARE to be able to service these unless you have some specialized skills. Typically, they are spot welded together, which can be dangerous to attempt to DIY. That said, often when a battery 'fails', it's actually just one 18650 that has failed and taken the others down with it.
These days you do see other sizes. 21700s or even pouch batteries are starting to be more common when tools need more stored joules per unit volume.