In general conversation, no. We wouldn’t say that Hoiston is X miles from Dallas, we’d just say about 4 hours. Same with distance between Fort Worth and Dallas, we use time to convey distance.
It makes things easier for planning purposes to use drive time. We even say “drivetime” because that’s how long it takes to drive to the destination, whether that’s down the street to the store or a city across the state. It’s just like when you put in a destination on a GPS, it shows how long it’ll take to drive there, nothing more.