The SPEs on the cell processor are actually pretty good at rendering graphics. In a lot of late gen exclusive PS3 games you can see that the developers utilised them more and more for graphics rendering. So the plan was to have the SPEs on both cell processors do all the graphics.