“The principles in Constitutional AI act as a nudge to counteract pre-existing biases from human preference data, rather than as strict rules the model follows.”