“Anthropic uses Constitutional AI in combination with RLHF, which reduces the need for RLHF data while increasing the value of each data point.”