American accents sound too 'modern' because American English wasn't a thing until the Medieval period had long passed, and most fantasy is medieval or medieval-adjacent.
I'm all for broadening the use, though. I love that the Witcher games gave Geralt and the other Witchers of the School of the Wolf American accents. And Dragon Age (back when it was good) giving the dwarves American accents.