“The Transformer architecture has been more thoroughly vetted at scale compared to newer, alternative model architectures.”