The empirical neural tangent kernel (eNTK) for Low-rank adaptation (LoRA) is approximately the sa..., Sonic AI
“The empirical neural tangent kernel (eNTK) for Low-rank adaptation (LoRA) is approximately the same as that for full fine-tuning when LoRA is applied to all layers.”