“To mitigate numerical mismatch issues in MoE models, Cursor and Fireworks use a technique called 'router replay' where the inference pass explicitly tells the trainer which experts were activated for each token.”