“A key distinction of Reinforcement Learning from Human Feedback (RLHF) compared to standard pre-training is the ability to incorporate negative feedback.”