Serving

SGLang ships day-zero serving for a 2.4 trillion parameter mixture of experts

SGLang v0.5.19 landed on 5 September with day-zero support for Qwen3.8, 2.4 trillion parameters in total against 95 billion active. IBM Granite 4.2 and Ling 3.0 flash and tiny arrive in the same release. Day-zero means the checkpoint serves on the release that ships beside it, rather than after a follow-up patch.

Primary source read

Published in the edition of Monday, 7 September 2026 · Beat: Infrastructure