The thing is that the universe is as far as we can tell the not infinite, just infinitely expanding. The known universe is measurable (like 46 billion light years)
Idk what that implies for the existence of open space however. Like if that is infinite or if it is somehow created.