“The research and writing for the "Attention is All You Need" paper, which introduced the Transformer architecture, was completed in a 12 to 16-week period in 2017.”