I’ve been wondering for a while now if we’re even getting real results or if the seo results have made crawlers (as we know it) largely redundant. I doubt google has any real incentive to move away from the model that is now in place, unless they do intend to launch a paid service (free from the above mentioned garbage) alongside the existing service should competitors like kagi present a real threat to their business.