sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [XPU] Support XPU graph read-done events
- feat(metrics): expose deferred decode KV release metrics
- [Feature] Support configurable retention for request log files
- [AMD] One-launch small-M MoE router for Qwen3.5 on gfx950
- [AMD] Small-M W8A8 FP8 projection GEMM for Qwen3.5 AttnFP8 on gfx950
- [AMD] [GLM-5.3-Flash] Restore two HIP fallbacks: clamped-SwiGLU Triton MoE and the fused mHC boundary
- [quick examples fix] use correct metric names in example grafana dashboard (sglang_ -> sglang:)
- [PD] Consolidate sender and receiver implementations
- fix(mem_cache): restore default on UnifiedRadixCache.dec_lock_ref params
- [Feature] Gemma2/Gemma3: size sliding-window layers from the hybrid SWA pool
- Docs
- Python not yet supported