Neither would a black person who doesn’t have an accent. And white person is most likely not going to be asked “where are your ancestors from either”. But is it really so bad to be curious about a person’s ancestral background? Definitely tacky to have it be one of the first questions you ask though.