“Scaling AI models to attend to trillions of tokens is a major computational challenge because the naive quadratic attention algorithm is not feasible beyond millions of tokens.”