“A speculative problem with RLHF is that it optimizes for human approval and what sounds convincing, not necessarily for objective truth.”