I imagine it’s because Americans use foreign accents to make the fantasy more foreign itself. If the wizard who cast a spell to alter the passage of time starts talking like the dude that runs the gas station on the corner, maybe it takes away some of the magic.