“In experiments with GPT-4 class models, weak-to-strong generalization shows non-trivial positive results on a range of NLP tasks, with performance increasing even when extrapolating across four orders of magnitude in model size difference.”