Skip to content

Latest commit

 

History

History
95 lines (78 loc) · 5.43 KB

CUDA_VERSION_MATRIX.md

File metadata and controls

95 lines (78 loc) · 5.43 KB

CUDA Version Matrix

Image tags = Python versions

Topmost entry = Tag latest

Python CUDA cuBLAS cuDNN NCCL TensorRT1 Linux distro
3.13.12 12.6.3 12.6.4.1 9.6.0.74 2.23.4 n/a Ubuntu 22.04
3.12.8 12.6.3 12.6.4.1 8.9.7.29 2.23.4 10.7.0.23/
10.3.0.26		 Ubuntu 22.04
3.13.02 12.6.3 12.6.4.1 9.6.0.74 2.23.4 n/a Ubuntu 22.04
3.12.7 12.6.3 12.6.4.1 8.9.7.29 2.23.4 10.7.0.23/
10.3.0.26		 Ubuntu 22.04
3.11.10 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.12.6 12.6.1 12.6.1.4 8.9.7.29 2.23.4 10.4.0.26/
10.3.0.26		 Ubuntu 22.04
3.11.9 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.12.5 12.6.1 12.6.1.4 8.9.7.29 2.22.3 10.4.0.26/
10.3.0.26		 Ubuntu 22.04
3.12.4 12.5.1 12.5.3.2 8.9.7.29 2.22.3 10.3.0.26 Ubuntu 22.04
3.12.3 12.5.0 12.5.2.13 8.9.7.29 2.21.5 10.0.1.6 Ubuntu 22.04
3.12.2 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.11.8 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.12.1 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.11.7 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.12.02 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.11.6 11.8.0 11.11.3.6 8.9.6.50 2.15.5 8.5.33 Ubuntu 22.04
3.11.5 11.8.0 11.11.3.6 8.9.0.131 2.15.5 8.5.33 Ubuntu 22.04
3.11.4 11.8.0 11.11.3.6 8.9.0.131 2.15.5 8.5.33 Ubuntu 22.04
3.10.13 11.8.0 11.11.3.6 8.9.0.131 2.15.5 8.5.33 Ubuntu 22.04
3.11.3 11.8.0 11.11.3.6 8.9.0.131 2.15.5 8.5.33 Ubuntu 22.04
3.10.12 11.8.0 11.11.3.6 8.9.0.131 2.15.5 8.5.33 Ubuntu 22.04
3.11.22 11.8.0 11.11.3.6 8.7.0.84 2.15.5 8.5.33 Ubuntu 22.04
3.10.11 11.8.0 11.11.3.6 8.7.0.84 2.15.5 8.5.33 Ubuntu 22.04
3.11.12 11.8.0 11.11.3.6 8.7.0.84 2.16.2 8.5.3 Ubuntu 20.04
3.10.10 11.8.0 11.11.3.6 8.7.0.84 2.16.2 8.5.3 Ubuntu 20.04

Breaking changes

PyTorch/TensorFlow compatibility

Python CUDA PyTorch4 TensorFlow5
3.13 12.6 version ≥ 2.6 (experimental) n/a
3.12 12.6 version ≥ 2.2 version ≥ 2.16
3.12 12.5 version ≥ 2.2 version ≥ 2.16
3.12 11.8 version ≥ 2.2 version ≥ 2.16 (CPU-only)
3.11 11.8 version ≥ 2.0 2.15 ≥ version > 2.12
3.10 11.8 version ≥ 1.12 2.15 ≥ version > 2.8

Recommended NVIDIA driver (Regular)

CUDA Linux driver version Windows driver version6
12.6.3 ≥ 560.35.05 ≥ 561.17
12.6.2 ≥ 560.35.03 ≥ 560.94
12.6.1 ≥ 560.35.03 ≥ 560.94
12.5.1 ≥ 555.42.06 ≥ 555.85
12.5.0 ≥ 555.42.02 ≥ 555.85
11.8.0 ≥ 520.61.05 ≥ 520.06

Supported NVIDIA drivers (LTSB)

Only works with NVIDIA Data Center GPUs or select NGC-Ready NVIDIA RTX boards.

CUDA Driver version 5357 Driver version 4708
12.6.3 🟢 🔵
12.6.2 🟢 🔵
12.6.1 🟢 🔵
12.5.1 🟢 🔵
12.5.0 🟢 🔵
11.8.0 🟡 🟢

🔵: Supported due to the CUDA forward compat package
🟢: Supported due to minor-version compatibility
🟡: Supported due to backward compatibility

Footnotes

  1. amd64/arm64 ↩

  2. w/o numba ↩ ↩2 ↩3 ↩4 ↩5

  3. amd64 only ↩ ↩2 ↩3 ↩4 ↩5 ↩6 ↩7 ↩8 ↩9 ↩10 ↩11 ↩12 ↩13 ↩14 ↩15

  4. Installs its own CUDA binaries ↩

  5. The expected TensorRT version is symlinked to the installed TensorRT version.
    ❗️ This relies on backwards compatibility of TensorRT, which may not always be given. ↩

  6. GPU support in Docker Desktop | Docker Docs
    Nvidia GPU Support for Windows · Issue #19005 · containers/podman ↩

  7. EOL: June 2026 ↩

  8. EOL: July 2024 ↩