Some of the best large language models from China incorporate layers inspired by state-space arch..., Sonic AI
“Some of the best large language models from China incorporate layers inspired by state-space architectures, which allows them to operate with sub-quadratic cost.”