“From a user's perspective, AI infrastructure challenges are most commonly encountered first during the inference stage.”