GPU Drivers

Our Trooper.AI Blibs come pre-configured with NVIDIA drivers installed and tested during the provisioning process, ensuring immediate compatibility and optimal performance. We utilize the latest stable drivers for Ubuntu 22.04 LTS to support a wide range of applications and workloads. While we handle the initial configuration, advanced users have the flexibility to change driver versions independently via SSH access or by leveraging our dedicated GPU driver update template. This allows for customization based on specific application requirements or experimentation with newer driver releases. We recommend testing any custom driver changes in a non-production environment first.

Example Driver Output

This powerai.l1 Blib, serving our internal LLM and running Ubuntu 22.04, is pre-configured with NVIDIA driver version 565.57.01, supporting CUDA 12.7 and a full 450W power draw for optimal performance. All regular customers having full root access and can independently upgrade to newer driver versions, such as 570 or higher, to meet specific application requirements like CUDA 12.8+.

nvidia-smi output example
nvidia-smi output example

Official Nvidia Driver Support and SLA

Read more about official driver support for Linux here. This is an ongoing posting, which will be regulary updated by Nvidia devs: https://forums.developer.nvidia.com/t/unix-graphics-feature-deprecation-schedule/60588