If the door is moving 1 meter per second, you are relatively moving 1 m/s towards the door even if you are stationary on the ground. You pass and, although you are still stationary to the ground, you are still moving 1 m/s in the same direction relative to the door. The door is the frame of reference, not the ground.