sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Bug] --enable-mixed-chunk corrupts mamba radix cache checkpoints on hybrid GDN models (mixed batch skips extra_buffer write, slot still donated)
- [Bug]Unauthenticated PUT /route on Bootstrap HTTP allows route poisoning and metadata redirection
- [Bug] ep_scatter_from_psum missing expert_start/num_experts args → TypeError on deepep_v2 prefill
- [Bug] HiCache write_through does not fully persist first-seen prefixes before eviction
- [Tracking] Upstream remaining sglang-miles changes to main
- [Refactor][2/2] Rename FFN preparation APIs and runtime symbols
- [AMD] Qwen3-Next: route GDN decode at AITER's fused gfx950 kernel
- [Fix] fix Qwen3 MoE output corruption after EPLB rebalance
- [Diffusion] Add FLUX.2-klein 4B/9B XPU t2i and ti2i tests
- [PD] Make the KV checksum flag safe to enable
- Docs
- Python not yet supported