You forget that every adult (codes say male technically, so you could try disarming women and see what the supreme court says) not involved in military service is legally considered to be the unorganized militia, and only the national guard are considered the organized militia.