Trying to figure out what a person means from context instead of having the precisely correct words there takes more brain power, not less.
It takes far more energy to read and think in imprecise language. That’s the whole point of precise language: you don’t have to work as hard to interpret it.
But if you don’t mind speaking in broken English, no one can force you to learn.