The Attention Residue architecture shows the most significant performance improvements on coding,..., Sonic AI
“The Attention Residue architecture shows the most significant performance improvements on coding, math, and reasoning-heavy tasks, as measured by the GPQA, MATH, and HumanEval benchmarks.”