#open source ai infrastructure

Open Source Ai Infrastructure: 1 AI articles covering open source ai infrastructure news, analysis, and research

Articles

Buoyant Launches Kinference: An Open Source Inference ControlNEW⭐7

📅 34分钟前👁 4 views

Buoyant releases Kinference, an open source inference control plane for Kubernetes and vLLM, adding routing, token rate limits, KV-cache-aware load balancing, a...