“In early Mixture-of-Experts models with thousands of experts, individual experts were found to be relatively interpretable, specializing in concepts like cylindrical objects or dates.”