Kinference: Open-source inference control plane for vLLM

(vllm.ai)

2 points | by joshcsimmons 5 hours ago ago