Typically Amazon or Ali Express. RetroGamesCorp has created a couple review videos on them.
Even then you could get an old computer (or laptop) and install Lakka on it and just download the ROMs yourself. The whole setup process can be done in a weekend. After that you could just get some cheap knock off Xbox 360 controllers.