“The scaling laws from Kaplan et al. (2020) concluded that for optimal performance, model size should grow faster than dataset size, with the optimal model size N_opt proportional to C^0.73, where C is compute.”