“Aidan Gomez believes Google did not understand the significance of the Transformer architecture when they published the "Attention is All You Need" paper, otherwise they would not have open-sourced it.”