sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- docs(cookbook): migrate Gemma4 to the config-driven template
- [Feature] add --language-model-only flag to skip multimodal encoder loading and serve in text-only mode
- fix mamba radix partial page prefix matching
- refactor(attn/cpu): route eager metadata init through out_graph
- Guard FlashInfer MIS uint16 metadata overflow
- Fix Llama32 tool-call parser truncating text after final call
- fix: recover templated path for FastAPI >=0.137 included routers in the Prometheus middleware
- feat(router/cache_aware): weight worker selection by priority/cost labels
- [AMD] Enable pa_decode_gluon for Qwen3.5-MoE and fix decode split count
- Add Command A+ cookbook
- Docs
- Python not yet supported