A formal information-theoretic framework called Excess Description Length (EDL) has been develope..., Sonic AI
“A formal information-theoretic framework called Excess Description Length (EDL) has been developed to quantify the predictive structure that fine-tuning extracts from a training dataset and incorporates into a model's parameters.”