“The Internal Coherence Maximization (ICM) algorithm outperforms training on crowdsourced human supervision on the GSM8k-verification, TruthfulQA, and Alpaca reward modeling tasks.”