“OpenAI's attempts to use GPT-4 to assist with alignment research by fine-tuning it on alignment data were not very useful.”