Why do you need to call him something if it’s inaccurate? Just call him a child rapist and be done with it. Words have meanings and there is no reason to use them incorrectly.
As for who it’s hurting: everyone. Pedophila literally has nothing to do with rape. It is a disorder. It’s estimated it effects as much as 3% of the population. The vast majority of those people have never done anything wrong. They were simply born that way. The more people conflate the medical term with crimes the less likely pedophiles are going to seek help or treatment. Nobody wants to risk being outed as part of the most hated group of people on the planet.
If you want to actually help children instead of being angry the best course of action is to destigmatize the disorder so people can get counseling without fear of ruining their lives. Forcing people to bottle up their feelings/urges/etc. does not lead to good outcomes.