I wouldn’t be as worried about oxygen, but more worried about properly sealing the container off as a water leak could cause the lithium in the battery’s to produce hydrogen.
But the odds off either happening are very slim.
Edit: the water has to come in contact with the lithium.