Browsing Tag
SGLang
1 post
SGLang model serving, inference engines, structured generation, and production AI infrastructure coverage.
llm-d 1.0 Brings Agent-Aware Routing to Kubernetes AI Inference
llm-d 1.0 stabilizes APIs, adds agent-aware routing and coordinates zero-downtime inference upgrades. Here is what platform teams should test before migrating.
