Buoyant Releases Kinference, an Open-Source Inference Control Plane for Kubernetes
Buoyant has released Kinference v0.1.0-alpha.7, an Apache 2.0 control plane that routes requests across vLLM workers on Kubernetes using declarative policies, queue state and KV-cache signals. Self-reported tests showed...