“According to Dario Amodei, AI labs are currently spending only around $1 million on reinforcement learning (RL) for a given model, compared to hundreds of millions on pre-training.”