Browsing Tag
llm-d
1 post
llm-d distributed inference, Kubernetes-native AI serving, routing, caching, and production deployment coverage.
llm-d 1.0 Brings Agent-Aware Routing to Kubernetes AI Inference
llm-d 1.0 stabilizes APIs, adds agent-aware routing and coordinates zero-downtime inference upgrades. Here is what platform teams should test before migrating.
