I’m not entirely sure but it always seems like a in-game time of day thing to me. In one of my worlds I used to leave to swamps in the morning and return at nightfall and that would put the wind on my side but if I reversed the times the wind would be against me.