Honestly, yes. The nominal reason we give states federal money for highways that there’s a benefit to other states from one state having highways passing through it. If you’re not going to non-selectively give use of your highways, you’re not universally benefiting your neighboring states, so you shouldn’t get the money.
Now, the actual reason we take tax money from people in one state, give it to the federal government, just to have the it dish the money back out to the states is so the federal government gets a bunch of leverage over the states. It’s not actually efficient to collect a bunch of money, which costs money, and then give most of it back, which also costs money. It’s about control.