I would definitely make it clear I was asking about their family history, not them personally. I told the other person who replied that the only two times I could envision asking someone where they were from were if they had an unusual accent or if I found out we were both from the same state. I just didn’t know if it would be touching upon a sensitive topic that they get asked about way too much and it’s just not something that should be broached until you know someone pretty well.