It’s because we can not imagine letting people in for free if they don’t “earn” it. Sports scholarships let people pretend that they earned their place in the school because they worked hard to get there, ignoring the fact that sports are not academic in any way.
Taking away sports scholarships without making college free would just result in these athletes never getting degrees.