“Future Mixture-of-Experts models will likely feature experts that vary in computational cost by factors of 100 to 1,000, with dynamic routing paths.”