“Meta redesigned its pre-training stack over the last nine months to improve token efficiency.”