“Moonshot AI successfully trained a 1 trillion parameter model, K2, using the MEUM optimizer with the QK-CLIP technique, marking the first successful large-scale training with this optimizer.”