But there really is an interference pattern. Whatever is happening is physical, not metaphysical, and is happening “through” or “because of” both slits at the same time.
Unless you’re trying to argue that the statistical behavior of electrons is somehow decoupled from the behavior or each individual electron, which would seem to me to be a very odd metaphysical position.