sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- [Doc] [AMD] cookbook: Add GLM-5.3 MI355X AgentX recipe
- [Feat] unified-memory: Evict Full and SWA KV from one shared LRU order (joint_lru)
- [Fix] hicache: Fix host-memory registration failures in Confidential Computing
- [Fix] flashinfer: convert base-2 LSE to natural log in _safe_merge_state Triton fallback
- [Fix] weight-sync: Add selector to update_weights_from_disk
- [Feat] lfm3: Add text, vision, audio and Omni support
- [RFC]: KV Cache Events for HiCache L3 Storage Backends
- [Refactor] pd: Extract NixlTransport behind the common Transport interface
- [Feat] openai: support field-specific assistant continuation
- [Perf] [AMD] cuda-graph: breakable prefill graphs for prefix extends
- Docs
- Python not yet supported