🚀 The feature, motivation and pitch

CUDA 12.8.0 is out, adding to CI/CD.

Docker Images & Windows AMI Update

• Add CUDA 12.8 installation and manylinux-cuda12.8 #145567
• Add CUDA 12.8 libtorch image #145789
• Magma build - Add magma cuda build 12.8 #145765
• Use Magma-cuda 12.8 for libtorch #146019
• Windows AMI - Add CUDA 12.8 Windows AMI test-infra#6243
• Windows magma build - windows Magma and cuda build for cu128 #146653
• Fix var CUDA_PATH_V128 in cuda128.bat file #146906

CD Update

• Add CUDA 12.8 manywheel x86 Builds to Binaries Matrix #145792
• Add CUDA 12.8 windows nightly build #147037
• Add libtorch nightly build for CUDA 12.8  #146265
• Add CUDA 12.8 torchaudio and torchvision x86 builds test-infra#6244
• [aarch64] CUDA 12.8 aarch64 builds to nightly binaries #146378
• [aarch64] Add aarch64 cuda 12.8 domain builds test-infra#6257
• add sm_100 and sm_120 to cuda 12.8 domain builds test-infra#6273
• [cuDNN] cuDNN to 9.7.1.26 for CUDA 12.8 #146957
• Nccl update to 2.25.1 for cuda 12.4-12.8  #146073
• Add Cu128 Windows Torchaudio and Torchvision Builds test-infra#6308
• Deprecate sm70 for cuda 12.8 binary #147607
• [aarch64] add libcufile for cu126 and cu128 #148465
• [BE]: Update CU128 cudnn to 9.8.0.87 #148963
• [binary builds] torchaudio Windows cuda nightly builds are failing since 01.29.2025 audio#3877

CUDA 12.4 deprecation and CUDA 12.6 CI benchmarks

• Disable CUDA 12.4 nightly build test-infra#6333
• Remove 12.4 x86 builds and 12.6 sbsa builds from nightly  #148895
• [CI][CUDA] Move away from cuda12.4, Add cuda12.6 eager CI tests #148602
• [CI] [inductor] Add cu126 inductor jobs and move away cu124 #148612
• CUDA 12.6 Inductor accuracy test failures #148699

Alternatives

No response

Additional context

No response

cc @atalman @malfet @ptrblck @msaroufim @eqy @nWEIdia