So I finally figured it out. this is how that toggle works:
it only appears when you manually search for a song or select a song from certain groups on the home page.
it does not appear to appear if you select a song from “listen again” or “quick picks” in which case the app forces you to listen to whatever is in their queue unless you manually clear the queue.