You can’t set a recording resolution, it seems to max out at 1080p. On my 3440x1440p ultrawide I get 1920x804 as it fits the ultrawide aspect ratio into the horizontal resolution of 1080p.
It only uses h264, new cards support AV1 so would be nice to actually use that.