Directx 11 in this case, played bg3 on Linux and that was the only option that worked, and it did work quite well.
As for when to use one or the other, just check protondb. People usually leave what they played on, they even leave some useful launch commands or solutions to issues that could possibly arise, so it’s always worth a look.