“In Anthropic's Constitutional AI, synthetic preference data is generated by having an AI model choose between two completions based on a randomly sampled principle from the constitution.”