“The open-source MuonClip optimizer is a drop-in replacement for the Adam optimizer and provides better performance for training transformer-based LLMs.”