#moe
Moe: 22 AI articles covering moe news, analysis, and research
Articles
Thinking Machines Lab Releases Inkling-Small: A 276B Total, 12B⭐8
Thinking Machines Lab unveils Inkling-Small, an open 276B-parameter MoE with 12B active, multimodal support, 1M context, and Apache 2.0 weights.
Knowledge Injection in MoE? Expert-Aware Contrast Decoding for⭐7
Expert-aware contrast decoding leverages distinct expert activation patterns to mitigate LLM hallucinations in MoE models, outperforming baselines across benchm...