I understand your concern, but I feel that free access will eventually erode the monopoly that journals have on conferring legitimacy. If only a few can read the actual text of a paper, the rest of us have to trust the journal’s quality control. But as papers become more accessible, they will start getting judged on their own merit, rather than based on the journal’s impact factor. This change could take years to happen completely, but at this point I feel that it will happen sooner or later.