It depends on what is under that dirt. Is it deep enough for a root system, are there utilities under that, etc?
Also, mature trees will need some space for the root system to collect water and spread without destroying roadway. This is why a lot of warmer cities like to plant palm trees in medians - they have a pretty shallow / narrow root system.