The issue is growth rates are wildly different among different areas and cultures. The population in some places is dropping precipitously which will cause economic problems, especially around elder care.
While I agree that a gradual population reduction would be beneficial, rapid declines will increase human suffering and should be avoided.