#offline inference
Offline Inference: 1 AI articles covering offline inference news, analysis, and research
Articles
Meet Needle 2: An Open 45M-Parameter Tool-Calling Model That⭐7
Meet Needle 2: a 45M-parameter tool-calling model in a 14MB binary, running sessions in 28MB of RAM for edge devices.