“Progress in AI is driven more linearly by increases in compute and data, whereas algorithmic breakthroughs like the Transformer architecture or the Adam optimizer have a non-linear, paradigm-shifting effect.”