sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Fix] Preserve retained stop tokens in renderer incremental frames
- [Fix] Keep media fetch permits until blocking I/O finishes
- [Fix] Skip cancelled requests in the dynamic batch tokenizer
- [Model] Support IQuest-Q1 FP8 per-expert scales in main and MTP loading
- [Renderer] Avoid rescanning buffered SSE event prefixes
- [XPU CI] Optimize PR CI per-file timeouts and fail hanging tests fast
- [Fix] Preserve large integer tool arguments in Qwen3 Coder
- [Feature] Native GPT-Neo support
- [AMD] fix: refresh AITER decode graph metadata
- Fix MiniMax M2 non-null arguments in nullable schemas
- Docs
- Python not yet supported