“An analysis by Pearce & Song (2024) suggests the discrepancy between Kaplan et al. and Chinchilla scaling laws is partly due to Kaplan et al. excluding embedding parameters and experimenting on smaller models.”