sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- Guard FlashInfer MIS uint16 metadata overflow
- Fix Llama32 tool-call parser truncating text after final call
- fix: recover templated path for FastAPI >=0.137 included routers in the Prometheus middleware
- feat(router/cache_aware): weight worker selection by priority/cost labels
- [AMD] Enable pa_decode_gluon for Qwen3.5-MoE and fix decode split count
- Add Command A+ cookbook
- Fix Mooncake Store crash with asymmetric MHA models and disable incompatible JIT write-back
- [RL] GLM 5.2: skip shared indexer weights from RL weight check
- Enable tensor descriptors in the Triton extend-attention kernel
- [LoRA] [WIP] Add experimental MoL route-decode KV reuse patch
- Docs
- Python not yet supported