“Google and OpenAI are likely not using Direct Preference Optimization (DPO) because they have the resources to implement more complex and potentially higher-performing methods.”