GPT-4, mentioned 262 times across podcast episodes and expert conversations analyzed by Sonic.
AI scaling laws have held true over approximately 15 orders of magnitude of compute, from early models documented by Kaplan to GPT-4.
The per-token inference cost of GPT-3 at its launch was higher than the current per-token cost of the more capable GPT-4.
The performance gap between the initial and current versions of GPT-4 is larger than the gap between Claude 3 Opus and Claude 3 Haiku, which have a 60x price difference.