This is correct in most cases but I don’t think it’s the underlying principle.
This wiki talks about the etymology, with a lot of examples. Most conform to this rule, but there are exceptions in astrophysics like an accretion disk.
Even in info tech, “hard disk” doesn’t really conform to this rule. Like is a hard disk a square hard drive or is it the round thing inside? If it’s the square hard drive, that’s not thin enough to be a “disk”. I’d it’s the round thing inside that would be hard disc, but also creates problems for floppy disk because why refer to the housing in one instance but not another.
Sadly, I think the correct answer is that either refers to a thin flat thing, some spellings are preferred for some uses.