“Where are you from” should never mean ethnicity, but only where that person has lived. “What is your ancestry/ethnicity” should be specified if that’s what you’re asking about. No white person with an American accent would think anything of being asked where they’re from and will respond with where they’ve lived.