Rainer Pope estimates that current frontier models are over-trained by a factor of approximately ..., Sonic AI
“Rainer Pope estimates that current frontier models are over-trained by a factor of approximately 100 relative to the optimal token-to-parameter ratio suggested by Chinchilla scaling laws.”