Yes, it prevents elitism. If you have difficulty sliders, rather than accessibility options, in a game known for difficulty, you will have endless numbers of elitists claiming only the hardest difficulty is valid.
Rather than having difficulty options, allow players to tailor the difficulty to their own preferences via leveling at their leisure.
You still haven’t explained what you actually want.