sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- Fix NVFP4 RunAI streamer pending weight ownership
- docs: note flashinfer-cubin upgrade path for pip users
- [RFC][Feature] Extract an In-Process Route Planner from experimental/sgl-router's PD Workflow
- [HiCache] Add Mooncake replica placement controls
- [AMD] Support gfx1100 in ROCm AOT kernel builds
- feat(dp): DP waiting-queue load balancing with PD-prefill migration (mori)
- [AMD] GLM-5.2 MXFP4 MI355X: validate MTP 5-1-6 on gfx950 (v0.5.16+)
- [RFC] Incremental test cleanup, CI taxonomy, and shared diffusion dispatch
- fix(function_call): don't emit qwen3_coder separator whitespace durin…
- [Docs] Fix --encoder-transfer-backend default and options
- Docs
- Python not yet supported