If it slowed down it would get closer, not further. The truth is, any orbit is only stable given a specific timeframe. The longer that timeframe, the less likely any given orbit is to remain. The moon has just a little bit more speed than the Earth can hold onto, so it is in an extremely slow escape, and always has been.