It’s not people using the neutral that bothers me, it’s the fact that the neutral is both singular and plural while the non neutrals are only singular/plural.
and the plural part also alters the entire sentence structure to plural.
“He is over there” - Singular and easy to understand
“They is over there” - Just sounds wrong.
“They are over there” - Both singular and plural. Is it a person of unspecified nature or multiple people of mixed ones?
English could use a popularization of a strictly singular neutral that doesn’t carry implications of being an object rather than a being (“It is over there”)