Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought⭐7

Mixture-of-Experts routing follows a Frequency-Diversity Law, acting like neural Huffman coding. New Subset Difference Pruning eliminates redundancy, pushing Mo...