sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Bug] Janus-Pro CLIPVisionTower image normalization cannot run: Normalize is shadowed, and the transform calls torch.nn.functional.normalize
- [Elastic EP] Start a scale joiner at pipeline stage 0
- Implement the multimodal import diagnostics fix
- fix(function_call): honor SGLANG_FORWARD_UNKNOWN_TOOLS in one-shot Qwen3Coder/Gemma4/KimiK2/KimiK3 detectors
- [Qwen3.8 CP 2/4] Route on local rows and reduce-scatter the expert output
- [Qwen3.8 CP 3/4] Collocated prefill CP integration
- [Qwen3.8 CP 4/4] Prefill context parallel E2E support of Qwen3.8
- [HiCache] Page unified e2e integration
- [Fix] Propagate profiling failures from all workers
- [WIP] [DO NOT MERGE] spec: DCP draft-extend fixes (EAGLE3+DSPARK) + SGLANG_DSPARK_MAX_VERIFY_LEN
- Docs
- Python not yet supported