“Aidan Gomez, a co-author of the original Transformer paper, expresses surprise at the continued dominance and longevity of the Transformer architecture in AI.”