Gamer 1 notices something weird and then sees that the second controller is still on and disconnects it. That is the easy fix.
Plus in any case like this will only happen if you enabled this sharing controller thing just before. Most of the time you will not be playing with it enabled.