Most email clients do not keep a copy of your email on their own servers. It is increasingly common though as it allows them to offer features which are impossible to do otherwise.
I don’t believe there is any need for them to keep a local copy of your mail for push notifications.