“Aiden Gomez states that large-scale AI training has evolved from using tens of GPUs when the Transformer was developed to tens or hundreds of thousands of GPUs today, with a projection of millions in a couple of years.”