#quantization
Quantization: 3 AI articles covering quantization news, analysis, and research
Articles
Liquid AI Open-Sources Pipette: A Reproducible Benchmarking Suite That Measures On-Device Models,⭐7
Liquid AI open-sources Pipette, a benchmarking suite measuring on-device AI models across quantization, runtime, and hardware to reveal real-world edge performa...
Thinking Machines Lab Releases Inkling-Small: A 276B Total, 12B⭐8
Thinking Machines Lab unveils Inkling-Small, an open 276B-parameter MoE with 12B active, multimodal support, 1M context, and Apache 2.0 weights.
Bringing Nunchaku 4-bit Diffusion Inference to Diffusers⭐8
Nunchaku 4-bit diffusion inference is now in Diffusers, enabling efficient text-to-image generation with reduced memory and faster speeds on consumer hardware.