I thought I was alone with that feeling. I’m in exactly the same boat as you.
For me, it’s a tiny bit different, because I played BOTW shortly before my daughther was born in 2017. I still had time for games like that back in the day. Now I don’t only have a daughter, but a son as well.
When I grab the controller and start playing something time intensive like BOTW and now TOTK, I usually feel really guilty really quick, because there are so many other things to do, that in theory should have a higher priority.