“Olmo Hybrid is a 7-billion-parameter model where the sliding window attention layers of the Olmo 3 7B model have been replaced with Gated DeltaNet layers.”