“Free” in the sense that the state(s) cannot interfere with what is taught. It’s the same meaning of “free” as in “land of the free”, not as in “free beer”.
However, all public tuition (primary school, secondary school, and universities) really is free as in “free beer”. Only kindergarten and private schools aren’t.