sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- feat: add eagle3 spec decoding for minicpm
- Support manually set dp_ranks for slow_down
- [bugfix] cutlass_mla_decode is incorrectly declared when CUDA_VERSION…
- Support DeepEP 10-bit logfmt combine
- Benchmark: Improve path of check_chat_template
- [Feature] Support piggyback server load report.
- [Feature] Reduce constrained-decoding overhead in TP
- Modify data_hash to use full SHA-256 digest
- Optimize Decode for VLM
- [Roadmap] SGLang Prefill-Only 2026 CY26H1 and CY26H2 Design Proposal & Roadmap
- Docs
- Python not yet supported