According to a study by Gekhman et al. (2024), LLMs learn fine-tuning examples with new knowledge..., Sonic AI
“According to a study by Gekhman et al. (2024), LLMs learn fine-tuning examples with new knowledge slower than examples consistent with their pre-existing knowledge.”