“Andrei Karpathy describes LLM pre-training as a "crappy evolution" because it is the practically available method for creating a starting point with built-in knowledge, analogous to what biological evolution accomplishes.”