sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- fix(bench_serving): record flushed_cache state in benchmark results
- [Bug] Apple Metal (mps) reports no device memory capacity, so mem_fraction_static falls back to 0.95 and prefill OOMs
- DSV4.1 PD Road Map
- [BugFix] Fix Janus-Pro CLIPVisionTower Normalize shadowing and mean/std normalize
- [BugFix] Reset send_token_offset on input_embeds retract
- [NPU][HiCache] Support DeepSeek V4 L3 with MemCache
- Fix unbounded chunk_idx growth in PD staging STAGING_REQ handler
- Session traffic (streaming/tree sessions + aborts + close_session) trips 'pool memory leak detected' (session_held) on dev head 741f05e6, lease pool OFF
- [Bug] GLM-5.3-Flash (glm5_next): image requests render a no-multimodal reminder instead of the image placeholder — model never sees the image
- [Bug] OpenAI Chat Completions: Python SSE chunks have inconsistent id and created
- Docs
- Python not yet supported