I’m guessing it’s because different parts of us mature at different rates. Brain development continues into the early twenties, so mind-altering substances are generally regulated with that in mind. Physical maturity ends in the late teens, so things like military service eligibility start there. Other activities are based on more abstract measures like responsibility, emotional stability, etc.