#mixture-of-experts
Mixture-Of-Experts: 27 AI articles covering mixture-of-experts news, analysis, and research
Articles
Alibaba Qwen Unveils Qwen3.8-Max: A 2.4-Trillion-Parameter MoE⭐6
Alibaba unveils Qwen3.8-Max, a 2.4T-parameter MoE model with open weights next week, plus Qwen3.8-27B for practical deployment.
Topology-Aware Data Movement for Disaggregated GPU Inference⭐10
Topology-aware KV cache transfer cuts GPU inference latency by 3-18x via NVLink, InfiniBand, and CXL optimizations.
Thinking Machines Lab Releases Inkling-Small: A 276B Total, 12B⭐8
Thinking Machines Lab unveils Inkling-Small, an open 276B-parameter MoE with 12B active, multimodal support, 1M context, and Apache 2.0 weights.
AMD Releases Instella-MoE-16B-A3B: A Fully Open⭐7
AMD unveils Instella-MoE-16B-A3B, a fully open MoE LLM with 2.8B active parameters, trained on Instinct GPUs, offering complete transparency for research.
Induction Labs Photon-1: A Single Pretraining Run Powers Desktop⭐7
Induction Labs debuts Photon-1, a 106B-parameter MoE model that learns from pure video observation. It powers desktop simulation, checkers, and billiard
Is MoE Routing a Huffman Code? Discovering the⭐7
Mixture-of-Experts routing follows a Frequency-Diversity Law, acting like neural Huffman coding. New Subset Difference Pruning eliminates redundancy,
Knowledge Injection in MoE? Expert-Aware Contrast Decoding for⭐7
Expert-aware contrast decoding leverages distinct expert activation patterns to mitigate LLM hallucinations in MoE models, outperforming baselines across benchm...