“A key research problem for language models is the difficulty of assigning a clear reward signal (true/false), unlike in games, because language is inherently fuzzy and subjective.”