Edited the original post but might aswell comment it. I switched to GNOME (Wayland) and the FPS issue seems to be gone there. I ran the game with only the command line arguments “gamemoderun %command%” in steam and it seems to work properly. Very odd issue.