Well, there is some sense in that. Mining/construction would require special licensing as well for it, and that would be fun to watch a miner or builder using frags to demolish something. )
Silencer is the same to me, as you rightly point out: this is never a self-defence device, there is no conceivable use for one if you are not a certain Bond, J Bond. Who also had a rather specific license!