I wouldn’t sweat so much picking a close server as long as it has enough users to be around for a while, reasonable rules, and isn’t under too much strain. Just by getting off the big servers, you’ll have a much faster experience and access to the same content.
I moved from lemmy.world to this one that specializes in my interests, and it’s running great.