“Algorithmic efficiency for LLMs has been improving at a rate of approximately 0.5 orders of magnitude per year from 2012 to 2023, according to EpochAI estimates.”