“NVIDIA's Ampere architecture GPUs are no longer favored for inference because they lack support for FP8 quantization, which makes Hopper GPUs significantly more cost-effective.”