“The use of transformers for decision-making tasks, such as in the Decision Transformer paper for offline reinforcement learning, marked the early days of combining these fields.”