Most LEO are just hired and trained under top level officers supervision. Top level officers are elected. Thus the public can vote their ass out if they turn out to be criminals.
Otherwise, the only oversight they would have would be the mayor, which the mayor would have their own private army basically. Doing whatever the mayor wants or they are fired…