We can directly measure the distance to nearby stars by observing how much they move against the backdrop of distant galaxies as the Earth moves around the sun.
If all stars were the same distance away they would maintain their relative positions like some sort of cosmic wallpaper.
Instead it’s like moving through a forest and seeing near trees block far ones.