Running The Ngc Containers With Gpu Support; Using Native Gpu Support - Nvidia DGX A100 User Manual

4.7 Running the NGC Containers with
GPU Support
To obtain the best performance when running NGC containers on DGX A100 systems, two
methods of providing GPU support for Docker containers have been developed:
Native GPU support (included in Docker 19.03 and later)

NVIDIA Container Runtime for Docker (nvidia-docker2 package)

The method implemented in your system depends on the DGX OS version installed.
DGX OS Releases
5.0
Each method is invoked by using specific Docker commands, described as follows.
4.7.1

Using Native GPU Support

Use docker run --gpus to run GPU-enabled containers.
Example using all GPUs

$ sudo docker run --gpus all ...
Example using two GPUs

$ sudo docker run --gpus 2 ...
Examples using specific GPUs

$ sudo docker run --gpus '"device=1,2"' ...
$ sudo docker run --gpus '"device=UUID-ABCDEF,1"' ...
DGX A100 System
Method included
Native GPU support
NVIDIA Container Runtime for Docker (deprecated -
availability to be removed in a future DGX OS release)
Quick Start and Basic Operation
DU-09821-001_v06 | 26