“For companies operating at scale where failures have catastrophic consequences, implementing rigorous and comprehensive evaluation (eval) systems is critically important.”