You’re thinking of the # of representatives not growing with the population like it’s supposed to. But even then, they ARE reapportioned based on the census. The census also reapportions electoral votes. AND if there’s enough population shift there’s also the redrawing of district lines.
So basically, yes FL losing / drastically shifting population could impact all sorts of things every 10 years.