sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Fix][Qwen-VL] Don't count literal <image> text as an image placeholder
- [Fix] Configure logging in tokenizer worker processes
- 【NPU】Add a deployment tutorial for GLM-5.3 and GLM-5.3-flash on NPU
- [DSpark] Skip top-p renorm on compact verify padding rows
- [HiCache] Fix host-pointer handling on WSL2
- [DSv4.1] Bound prefill indexer score tiles by a memory budget
- [Fix] Keep Hermes streaming text in order around tool calls
- fix: propagate data-parallel scheduler startup errors
- [Feature] [Diffusion] Support LingBot-VLA 2.0
- [ROCm] Support ratio-3 fused GDN qkvzba split on AITER/HIP
- Docs
- Python not yet supported