Even if they are next door, who cares. If you’ve got hybrid/remote status, you don’t have to put on pants today. Some days you just don’t want to get out of your pajamas.
And if you are within walking/biking/no-transfer range, chances are there’s a bunch more other employers in the neighborhood, and several of them will let you work hybrid.