#kinference
Kinference: 1 AI articles covering kinference news, analysis, and research
Articles
Buoyant Launches Kinference: An Open Source Inference ControlNEW⭐7
Buoyant releases Kinference, an open source inference control plane for Kubernetes and vLLM, adding routing, token rate limits, KV-cache-aware load balancing, a...