“An inference pipeline optimized for specific hardware could become obsolete in 18 months due to the rapid pace of hardware innovation.”