NVIDIA's TensorRT LLM is an open-source SDK that can optimize inference performance on NVIDIA hardware with only a few lines of code.

Google Cloud is adding NVIDIA's Blackwell GPUs, specifically the RTX Pro 6000 model, to its offerings.

The NVIDIA RTX Pro 6000 GPU features 96 gigabytes of VRAM, which enables the deployment of multiple models on a single GPU.