It is because most of the EU participates in an agreement without hard borders and is united by a larger entity that collects taxes and holds elections in its states/countries.
The degree of federalism is higher in the USA than Europeans think it is. After all, each American state has at least one army.