#torchtitan

Prime Intellect Releases Prime Mega MoE: A Trainable Fused MoENEW⭐8

Prime Intellect releases Prime Mega MoE, a trainable fused MoE kernel with a backward pass, delivering up to 34% faster training and a 3.11x faster forward pass...