No, they’re not worried about joggling your junk. It’s because you need something like an extra half inch in the seam on the side you dress on to leave a little extra room in your pants for your dick. Well-tailored pants are asymetrical. Not sure those of you who wear briefs need to worry about it.