“Jürgen Schmidhuber states that the modern transformer architecture (from 2017) has quadratic scaling complexity, meaning a 1000x increase in text length requires a 1,000,000x increase in compute.”