Browsing Tag
SGLang
3 posts
SGLang model serving, inference engines, structured generation, and production AI infrastructure coverage.
Cloudflare GLM-5.3 Leak Exposed 155 Cross-Tenant Responses
Cloudflare’s hosted GLM-5.3 model returned 155 responses containing other customers’ data. Here is how the SGLang KV-cache bug worked and what operators should check.
Meta Runs Google TPUs in Production as TorchTPU Opens the Stack
Meta is serving production AI workloads on Google TPUs through TorchTPU. Here is what the PyTorch-native stack supports, where it remains uneven, and what teams should test.
llm-d 1.0 Brings Agent-Aware Routing to Kubernetes AI Inference
llm-d 1.0 stabilizes APIs, adds agent-aware routing and coordinates zero-downtime inference upgrades. Here is what platform teams should test before migrating.