“Knowledge distillation can help mitigate the "data wall" problem by extracting more signal per token from a finite dataset into a smaller model.”