sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Fix] hicache: Allow fallback for namespaced cgroup paths
- [Feat] Spark2.5: Support DSpark
- [CI] [NPU] unit: Fix two stale NPU unit test assertions
- [Fix] disaggregation: invalidate Mooncake and Mori PD peers before role switches
- [Doc][NPU] Various missing clarifications, prerequisites and validation steps in Ascend NPU documentation
- [Test] ngram: Add shared code-edit benchmarks for SGLang and TensorRT-LLM
- [Fix] scheduler: Process NGRAM grammar results before planning
- [Fix] cuda-graph: Keep an aligned top bucket and size draft graphs by their capture width
- [Fix] session: Keep recurrent state aligned with kept tokens
- fix(multimodal): preprocess images on the CPU with several tokenizer …
- Docs
- Python not yet supported