“OpenAI uses feedback from over 100 million ChatGPT users to create an aggregate of values to align the system.”