sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [AMD] diffusion: fix Qwen-Image 2.1 ROCm failures
- diffusion: support SenseNova DP/TP/SP parallelism
- [Spec] Add --speculative-draft-kv-ratio for all-SWA DFLASH drafts
- [AMD][MORI] Add MORI EP V2 support for DeepseekV4 Pro
- fix(attention): size flashinfer batch buffers for the eager warmup ceiling
- [NPU] qwen fused shared expert
- [HiSparse] Support DSpark and MTP speculative decoding
- [Fix] Don't let a failed deep_ep import-time check kill servers that never use DeepEP
- [AMD][CI] Run UMBP HiCache E2E through standalone SSD server
- [Misc] Add AGENTS.md and .agents symlinks so Codex can use .claude rules and skills
- Docs
- Python not yet supported