#inference control plane
Inference Control Plane: 1 AI articles covering inference control plane news, analysis, and research
Articles
Buoyant Launches Kinference: An Open Source Inference ControlNEW⭐7
Buoyant releases Kinference, an open source inference control plane for Kubernetes and vLLM, adding routing, token rate limits, KV-cache-aware load balancing, a...