“Mistral, Intel, and Stability AI have all released models trained with Direct Preference Optimization (DPO).”