That’s because the middle part of your vision sees detail much better but is less reactive to movement, but the outer part of your vision sees motion much better so it can notice the stutter more easily.
It’s also why low refresh rates are more noticeable on larger screens.