You’re using overly broad language. Multiple family members and myself get brutal headaches from aspartame. While that’s certainly not life threatening damage, it is fair to call that a harmful effect. I am not better off with many products switching to aspartame as a sweetener.
Yes, it is just an anecdote, but it’s enough to show that absolute statements don’t usually hold universally. Please stay open to the possibility of nuance.