sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Fix] [Intel] kernels: Recognize XPU capabilities
- [Feat] speculative: Online acceptance estimator for DSpark confidence-scheduled verification
- [Fix] scheduler: Count retracted output tokens as uncached HRRN work
- [Fix] deterministic: Disable the hybrid SWA memory pool with the radix cache
- [Perf] [Intel] gemma4: Fuse QKV normalization and RoPE
- [Feature] Support pending external linker lookup at native prefill admission
- [Feat] mem_cache: defer prefill for pending external linker lookups
- [Fix] scheduler: Cap aborted speculative output at max_new_tokens
- Fix stale sgl-kernel paths in Metal kernels README link labels
- [Feat] [NPU] multimodal: Enable device-side multimodal feature transport via torch_npu IPC
- Docs
- Python not yet supported