Yeah, if we aren’t in a hurry, and we can set up some fusion reactors and such on them and build whole civilizations on these rogue planets in the dark, it would work. Depends on how early and often we set up shop on passing planets, but in theory we could colonize much of the galaxy in a few revolutions around the milky way. So, under a billion years. ;)