“The Qwen 30B MoE model achieves performance roughly equivalent to their 14 billion parameter dense model.”