Actually, the answer turns out to be pretty interesting.
The short version is that what colors are considered "distinct" are heavily influenced by culture and Newton, from whom we get ROYGBIV, came from a culture which valued the dye called "indego."
Edit: It also seems Newton thought the number 7 had cosmic significance and thought there ought to be 7 colors.