“Increasing a model's context length by 4x in NVIDIA's Megatron-LM library reduces training efficiency by approximately 50%, even when normalizing for the total number of tokens.”