There is no source bc it is wrong. East Asian countries for example oftentimes didnt have a crown like equivalent hat with same importance.
Chinese empires for example saw the robe as much more important. Usurpers would be indicated by having a emperor robe, not crown. And there are other symbols. All of them more important than the emperor hat