“The standard scale for inference clusters is expected to rapidly grow from 8-72 chips today to thousands or tens of thousands of chips in the near future.”