Be careful with your solution. Ever other container you launch will attempt to access the Nvidia runtime, which gives access to the GPU. This may have unintended consequences, versus just running individual containers with Nvidia runtime set, and gpus=all set.