Composing or hybridizing different types of model layers, such as state-space models and full att..., Sonic AI
“Composing or hybridizing different types of model layers, such as state-space models and full attention layers, results in an architecture that performs better than its individual components.”