I converted my gaming machine into a server as well. I actually took the graphics card out as I couldn’t find a major use for it, but kept the 12 core Ryzen and upped it to 128gb memory. It now self host way too many things, including a few game servers my friends and I play… But even with all this, CPU carries along nicely and not even at half memory consumption (yet).
But as others have asked, what’s your goal? Don’t overkill it if you’re only hosting one service or something. If you’re doing a lot like I do, then up the RAM. And seriously consider whether the GPU is even useful or needed if you’re not using a desktop environment.