Gold isn’t finite, its supply increases every year and is the main reason for the stability in prices. Obviously this can’t continue forever, hence the finite resources on the planet
Two things you’re assuming is fiat can be evenly distributed with population growth and at some point the issuing body will reduce excess supply, neither of these things are common practices and rarely happen