Dario Amodei stated that AI model performance can degrade when a model trained on a small context..., Sonic AI
“Dario Amodei stated that AI model performance can degrade when a model trained on a small context length is then used at a long context length, according to a quote cited by Dwarkesh Patel.”