“The Groq LPU was designed before the publication of the 'Attention is All You Need' paper that introduced the Transformer architecture.”