You are correct, the caveat “added sugar” or added sweetener in this case is the important bit.
Fructose doesn’t have the same health effects of sucrose for some reason and the sugar you eat in fruit and veg come with fiber which helps keep our blood sugar from spiking.
I was shocked to learn that dates, which are basically candy, have a pretty reasonable glycemic index.