#on-device ai
On-Device Ai: 24 AI articles covering on-device ai news, analysis, and research
Articles
Silicon Valley's AI Wunderkind Launches Underdog, the Most⭐9
Self-taught coder Sigil Wen launches Underdog, a fully on-device, private AI assistant that runs locally on Mac and Windows, rivaling Instinct and Muse.
Meta Open Sources Muse Toolkit to Let You Build Your Own AI Gadgets⭐7
Meta open-sources the Muse toolkit, letting developers run its AI on Raspberry Pi and custom hardware for faster, private, on-device AI gadgets.
The Hidden Challenges of Edge AI Design⭐9
Edge AI design hides tough challenges in power, memory, and model compression. Learn the trade-offs engineers must solve for real-time, low-latency inference.
PrismML Brings Its Tiny LLMs to Qualcomm-Powered Smart Glasses⭐8
PrismML's 1-bit Bonsai LLM runs locally on Qualcomm Snapdragon AR1 Gen 1 smart glasses, shrinking models 4x while keeping near-full benchmark performance.
Qualcomm Unveils Snapdragon 8 Elite Gen 6 Chips, Doubling Down⭐9
Qualcomm's Snapdragon 8 Elite Gen 6 chips bring on-device AI agents, local 30B-parameter models, and pro-grade 8K camera features to flagship smartphones.
How to Use AI Without Sacrificing Your Privacy⭐9
Learn how to protect your privacy while using AI chatbots, from opting out of training data to incognito modes, and keep your personal conversations secure.
PrismML's Tiny LLM Could 'Change How We All Use AI' — Here's Why⭐9
PrismML compresses reasoning LLMs to run on PCs and phones, shrinking a 27B model to under 6 GB — a 9x-10x memory reduction that could reshape AI.
OpenBMB Releases MiniCPM5-2B: A 2.52B Dense Model Averaging 53.9⭐7
OpenBMB's MiniCPM5-2B: a 2.52B dense model scoring 53.9 across 34 benchmarks, excelling in code and tool use for on-device deployment.
This NAS Company Wants to Run Your Local Smart Home⭐8
Ugreen's HomeAgent NAS combines storage, security, and on-device AI for a private, local smart home hub arriving in 2026.
First Look: Nvidia's RTX Spark 'Superchip' Powers the Next⭐8
Nvidia's RTX Spark Superchip debuts at IFA 2026, bringing on-device AI to laptops and mini PCs from ASUS, Lenovo, and MSI. Launching in early 2027 from $1,200.