“Gavin Baker believes distributed inference clouds are a coming trend, as the factors that make distributed compute bad for training are beneficial for inference.”