“Scaling laws for LLMs have held for almost 10 orders of magnitude and are expected to continue holding with more careful research, data engineering, and scaling.”