I think that assumes that a person's attractiveness to a passive observer is equivalent to their attractiveness to their long-term partner. Someone who loves you probably thinks it's cute when your hair is messy, for example.
If you fall out of love, yeah, maybe leave your boyfriend. But if you still love him despite his beer gut and bald patch, maybe that's not a bad thing? Also, all relationships happen on a timeline, lol.