Problem you run into is the areas where we need to tie things to solar days across an area.
You end up with places having to regulate that school starts at 22:00, and gets out 05:00 the next day.
Businesses close for the night at 06:00 and open bright and early later that day at 22:00.
You have places where one calendar day has two different business days in it, so the annoyances faced by people who work overnight shifts spreads to everyone, and worse gets spread to financial calendars, billing systems and the works.