“In a future modular AI system, frequently used experts could be replicated for load balancing, while rarely used experts might be paged out from HBM to slower DRAM.”