sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Fix] eplb: Exclude draft statistics and reuse compatible TP groups
- [AMD] Route MiMo V2.6 target verify through AITER MegaMoE
- [Feat] nemotron_parse: Support Nemotron 3.5 Parse
- feat: add NCCL EP as optional moe-a2a-backend (low-latency decode)
- [Fix] scoring: Return token_logprobs for setwise CausalLM scoring
- [Perf] hicache: Space out write_back eviction waits with a bounded reserve
- [Fix] stop: Store the matched regex span, not the pattern
- [Fix] profile: Allow profile_by_stage without num_steps
- [Fix] nemotron: Accept transformers 5 layer type names
- [Perf] [AMD] dsa: Row-split the DCP indexer, run owned sparse MLA on the aiter asm kernel, and pipeline the a2a
- Docs
- Python not yet supported