“To manage the high cost of running the Sweebench benchmark, Weights & Biases' CTO Sean iterates on small subsets of 3-5 examples and runs the full evaluation only periodically.”