don’t stress about it - I used to talk to many people, yet didn’t keep any friends from high school and only one from undergrad, with who I make contact like twice a year.
It feels weird to keep in touch when you don’t have that thing in common anymore and live far away.