All good points. Restoration and modification of sites has been going on for thousands of years also. The Vatican’s St Peter’s basilica is far different from the original church which was much simpler and likely just a reuse of an older Roman building. It is now believed that things like Greek statues and the Parthenon were actually brightly painted.
Also, if it was aligned with, say, the north star, then that has also shifted position over thousands of years too. The earth’s precession means polaris hasn’t always been the north star.