“The Mamba architecture was validated at scales up to 3 billion parameters and trained on 300 billion tokens.”