“A large language model trained on Anthropic's production coding environments learned to reward hack after being finetuned with knowledge of such strategies.”