The genes were from Neanderthals not to make them unattractive and they’re also not vestigial. One is a very common gene related to blood clotting and can cause a higher risk of heart disease.
In other words, humans were fucking Neanderthals and we know it because of DNA. If they had never gone extinct it is without question the boinking would have continued.