“Early large language models typically underwent three levels of training: pre-training on a large corpus of internet data, instruction tuning on question-answer pairs, and alignment with human feedback to make responses more human-like.”