“Failing to batch users together for inference can result in costs that are up to 1,000 times worse than with proper batching.”