One thing is looks, the other thing is that input and processing may be tied to the FPS cycle. This means that games that run at e.g. 20fps could get an almost 50ms frame's worth of delay on any of your input, and game logic may also be limited to "inbetween" frames. At 20fps that's 50ms, at 60 it's less than 17ms.