sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Feat] [AMD] dsa: Enable DCP on the triton sparse-MLA backend
- [Fix] mem_cache: Fit automatic hybrid speculative state caches to available memory
- [Fix] dLLM: Reject unknown algorithm config keys
- [Test] [NPU] kimi_k3: enable L2 host HiCache for 32p gpqa accuracy test with host hit-rate bench
- [Fix] [AMD] GLM-5.3-Flash: Keep the MoE correction bias fp32
- [Perf] [AMD] GLM-5.3-Flash: One-launch MoE router and narrower KDA V tile for MTP verify
- [Feat] plugins: Add SGLANG_REQUIRED_PLUGINS for fail-fast loading
- [Feat] sgl-router: Add a Tair KVCache backend to the KV Indexer
- [Feat] [CPU] cpu-graph: Add prefill torch compile graph and dynamic graph support
- [Refactor] sparse-mla: Expose arithmetic and DSA metadata hooks
- Docs
- Python not yet supported