Browsing Tag
vLLM
1 post
vLLM inference engine, model serving, performance, deployment, and ecosystem coverage.
llm-d 1.0 Brings Agent-Aware Routing to Kubernetes AI Inference
llm-d 1.0 stabilizes APIs, adds agent-aware routing and coordinates zero-downtime inference upgrades. Here is what platform teams should test before migrating.
