AMD Releases Instella-MoE-16B-A3B: A Fully Open Mixture-of-Experts LLM With 2.8B Active Parameters Trained on Instinct GPUs⭐7

AMD unveils Instella-MoE-16B-A3B, a fully open MoE LLM with 2.8B active parameters, trained on Instinct GPUs, offering complete transparency for research.