You really nailed it. I’ll take it one step further though - religion as a concept is not the problem. Having gods, holidays rites and rituals - that’s all good.
It’s religion as an organization, when it gives people power which they can misuse when we start having problems.