Kimi Linear's core component, Kimi Delta Attention (KDA), extends Gated DeltaNet with a finer-gra..., Sonic AI
“Kimi Linear's core component, Kimi Delta Attention (KDA), extends Gated DeltaNet with a finer-grained gating mechanism to more effectively use limited finite-state RNN memory.”