“In 2024, open-source recipes like Llama 3 and Tülu 3 formalized a pipeline of Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning with verifiable rewards (RLVR).”