Well, if the sphere was there all along, yes, it’s possible. Very unlikely, but possible. If the whole universe is moving somewhere, we have no way to detect it. Note that this doesn’t exclude the Big Bang, that still happened even in your scenario.
It’s just one of those unprovable things - like whether there’s a God or whether we live in a Matrix. Unprovable and thus irrelevant.