“The amount of compute spent per data point in pre-training will increase by roughly 4x year-over-year due to the disparity in growth rates between compute availability and data generation.”