#inference engine
Inference Engine: 2 AI articles covering inference engine news, analysis, and research
Articles
Perplexity Open Sources Lily: A Rust + Metal Inference Engine⭐8
Perplexity open-sources Lily, a Rust and Metal inference engine for Qwen3.6-35B-A3B on Apple Silicon, powering Hybrid Compute with optimized performance.
Meet FreeToken: An Edge-Native MoE Serving Engine that Runs 753B⭐7
FreeToken enables running massive 753B-parameter MoE models on a single workstation GPU, democratizing high-scale AI inference for individual developers.