“Fireworks has developed a novel method to distribute fresh model weights quickly across geographically dispersed data centers, making large-scale distributed training on scattered GPUs numerically sound.”