The uniform aggregation in standard residual connections causes uncontrolled hidden-state growth ..., Sonic AI
“The uniform aggregation in standard residual connections causes uncontrolled hidden-state growth with model depth, progressively diluting each layer's contribution.”