sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Spec] Sample from the target when the rejection residual is empty in TreeSpeculativeSamplingTargetOnly
- Fix EVS for NemotronH_Omni_Reasoning_V3
- [Bugfix] Let the GLM47 tool grammar follow always-thinking templates (GLM-5.3)
- [LoRA 01/21] Shared hooks for the LoRA MoE and dense engines
- Parallelize EAGLE spec-decode KV index building over token blocks (flashinfer draft decode; verify/draft-extend for flashinfer, flashinfer_mla, aiter)
- [XPU] Fix SWA paged allocator
- [Fix] Cap SWA lock-walk pinning at one window in the Rust TreeCore
- Use a separate workspace for fmha_v2 prefill in trtllm_mha
- [Diffusion] Fuse FLUX3 SwiGLU with rowwise FP8 quantization
- [CI] Flaky tests and CI infrastructure failures seen while babysitting PRs
- Docs
- Python not yet supported