I tried out Gentoo for a while, and just using binaries for the web browser and office suite made the compile times a complete non-issue. The problem I had that made me give it up was that when there is software you want that isn’t in the official repos there are a thousand different ways of getting it, and all of them suck. Overlays are supposed to be the solution for that, but man that experience was just awful.
I tried all kinds of things, but in the end all the options basically boiled down to risking breakage, maintaining my own packages, or not using emerge at all, which just feels like it’s defeating the whole purpose of being on Gentoo in the first place.