podman¶

GPU support¶

The NVIDIA Container Toolkit nvidia-ctk needs to be installed. In order to run a podman container with GPU support, one needs to generate a CDI specification.

sudo nvidia-ctk cdi generate --output=/etc/cdi/nvidia.yaml
nvidia-ctk cid list

Container Device Interface

CDI is an open specification for container runtimes that abstracts what access to a device means, and standardizes access across container runtimes.

To run a podman container with GPU support, use the following:

podman run --device=nvidia.com/gpu=all <IMAGE> <COMMAND>

Error: setting up CDI devices

The folloiwng error

Error: setting up CDI devices: failed to inject devices: failed to stat CDI host device "/dev/nvidia-uvm": no such file or directory

can be fixed by generating the CDI specification with nvidia-ctk, as shown above.