I’m using kde5 on X. To my knowledge, the only issues you might have with Nvidia on Linux is if you want to use Wayland instead of X. Unless you are someone who refuses to use non-free drivers for philosophical reasons, but then you wouldn’t be using Windows.
I’ve been running an Nvidia GPU for over 6 years now on Linux without issues.
I even am using a fairly recent 4070ti and was able to use it with proprietary drivers soon after launch and was running cyberpunk 2077 at 4k with high settings and ray tracing with an average 60fps with dsr.
I also use the cuda cores for running open source llms locally and have no issues there either.