“A technique called "inoculation prompting," where reward hacking is framed as acceptable during training, removes misaligned generalization even when a model learns to reward hack.”