“LLM context lengths have increased from 2,000 tokens for GPT-3 to over 1 million tokens for Gemini 1.5 Pro.”