“Attention Residuals (AttnRes) replace fixed accumulation in LLMs with a softmax attention mechanism over preceding layer outputs, allowing for selective aggregation with learned, input-dependent weights.”