You mention ‘the settings’; though it’s ambiguous whether you looked at the desktop’s, wm’s, or panel’s settings – the relevant settings are the panel plugins’ own little settings widgets, which you can call from a right click menu on the panel plugins themselves.
It’s a bit convoluted; though that’s the so called ‘trade-off’ for Xfce’s modularity.