#mixture of experts
Mixture Of Experts: 4 AI articles covering mixture of experts news, analysis, and research
Articles
Moonshot AI Releases Kimi K3.1 Pro: A 2.8T-Parameter MoE Model⭐8
Moonshot AI's Kimi K3.1 Pro is a 2.8T-parameter MoE model with 104B active parameters, a 1M-token context window, and API access ahead of open weights.
Build and Train a 25M Parameter LLM From Scratch on Your CPU⭐8
Build and train a 25M parameter LLM from scratch on your CPU. This freeCodeCamp tutorial covers pre-training, RL fine-tuning, MoE, and modern AI research workfl...
Introducing Olmo-core 3: Open, Scalable Training Infrastructure⭐9
AI2's Olmo-core 3 delivers open, scalable training infrastructure for large Mixture-of-Experts models, tackling expert parallelism, load balancing, and checkpoi...
H Company Unveils Holo4: Open-Weight Computer-Use Models That⭐9
H Company's Holo4 open-weight computer-use models bring desktop, web, Android, and API automation to one Apache 2.0 agent stack with 256K context and strong OSW...