“A main challenge of the current Transformer architecture is its limited context length, which is insufficient for teaching complex tasks like StarCraft that require much larger contexts.”