I think the running counter story is that he felt more comfortable around kids than adults, but people couldn’t believe it was innocent. Its really hard to play the accusations game. Macaulay Culkin saying he spent tons of time with him and nothing bad ever happened is as much evidence for good as any of the accusations of wrongdoing.
I also think there was and still is a problematic understanding of psychology especially with small children.