“Hernandez et al. (2022) observed a double-descent phenomenon in test loss when training Transformer models on datasets containing a small fraction of repeated data.”