SDK Installation

Setup your developer kit:

^{* iGPU and dGPU can be used concurrently on a single developer kit in dGPU mode. See details here.}

This version of the Holoscan SDK has been tested on the following Superchips:

¹ ^{Ubuntu installation guide for Grace systems}
² ^{SBSA/SuperChips don’t support display output. Use HoloViz for headless rendering.}

Supported x86_64 distributions:

¹ ^{Not formally tested or supported, but expected to work if building bare metal with the adequate dependencies.}
² ^{Not formally tested or supported, but expected to work if supported by the NVIDIA container-toolkit.}
³ ^{Not formally tested or supported, but expected to work if the glibc version of the distribution is 2.35 or above.}

NVIDIA discrete GPU (dGPU) Requirements:

• GPU Architecture: Ampere or newer (recommended for best performance)

• GPUDirect RDMA: Requires Quadro/NVIDIA RTX series

• Tested with NVIDIA RTX A6000 and NVIDIA RTX ADA 6000

• Drivers: NVIDIA dGPU drivers 535 or newer

  • x86 workstations: Tested with OpenRM drivers R550+

  • CUDA Green Contexts: Requires drivers 560+ (optional feature)

• CUDA 13 (x86_64, Jetson Thor, DGX Spark)

  Copy

  Copied!

              
  
              
  docker pull nvcr.io/nvidia/clara-holoscan/holoscan:v3.7.0-cuda13
          

• CUDA 12 dGPU (x86_64, IGX Orin dGPU, Clara AGX dGPU, GH200)

  Copy

  Copied!

              
  
              
  docker pull nvcr.io/nvidia/clara-holoscan/holoscan:v3.7.0-cuda12-dgpu
          

• CUDA 12 iGPU (Jetson Orin, IGX Orin iGPU, Clara AGX iGPU)

  Copy

  Copied!

              
  
              
  docker pull nvcr.io/nvidia/clara-holoscan/holoscan:v3.7.0-cuda12-igpu
          

See details and usage instructions on NGC.

Install via APT package manager:

            

            
sudo apt update
        

• CUDA 13

  • x86_64, GB200, DGX Spark

    Copy

    Copied!

                
    
                
    sudo apt install holoscan-cuda-13
            

  • Jetson Thor

    Copy

    Copied!

                
    
                
    sudo apt install holoscan
            

• CUDA 12

  • x86_64, GH200

    Copy

    Copied!

                
    
                
    sudo apt install holoscan-cuda-12
            

  • IGX Orin, Jetson Orin

    Copy

    Copied!

                
    
                
    sudo apt install holoscan
            

Troubleshooting

Package not found: E: Unable to locate package holoscan

Platform-specific solutions:

• IGX Orin:

  1. Verify compute stack installation (configures L4T repository)

  2. If still failing, use arm64-sbsa from the CUDA repository.

• Jetson:

  1. Verify JetPack installation (configures L4T repository)

  2. If still failing, use aarch64-jetson from the CUDA repository.

• GH200: Use arm64-sbsa from the CUDA repository.

• x86_64: Use x86_64 from the CUDA repository.

Missing CUDA libraries at runtime:

            

            
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory
        

This occurs when multiple CUDA Toolkit versions are installed. To fix:

1. Find the library: find /usr/local/cuda* -name libcudart.so.12

2. Select correct version: sudo update-alternatives --config cuda

3. If library not found, reinstall CUDA Toolkit:

   Copy

   Copied!

               
   
               
   sudo apt update && sudo apt install -y cuda-toolkit-12-6
           

Missing CUDA headers at compile time:

            

            
the link interface contains: CUDA::nppidei but the target was not found. [...] fatal error: npp.h: No such file or directory
        

Same root cause as above (mixed CUDA versions). To fix:

1. Find the header: find /usr/local/cuda-* -name npp.h

2. Follow the same update-alternatives steps above

Missing TensorRT libraries at runtime:

            

            
Error: libnvinfer.so.8: cannot open shared object file: No such file or directory
        

Wrong TensorRT major version installed. Reinstall TensorRT 8:

            

            
sudo apt update && sudo apt install -y libnvinfer-bin="8.6.*"
        

Cannot import holoscan Python module:

            

            
ModuleNotFoundError: No module named 'holoscan'
        

Python support removed from Debian package in v3.0.0. Install the Python wheel instead.

Install via pip:

CUDA 13 (x86_64, Jetson Thor, DGX Spark)

            

            
pip install holoscan-cu13
        

CUDA 12 (x86_64, IGX Orin, Clara AGX, GH200, Jetson Orin)

            

            
pip install holoscan-cu12
        

See PyPI for details and troubleshooting.

Install via conda:

            

            
conda install holoscan cuda-version=12.6 -c conda-forge
        

See conda-forge for details and troubleshooting.