sglang
https://github.com/sgl-project/sglang
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to sglang
Help out
- Issues
- support for FalconForCausalLm 7b and 1b
- feat: add XingChen4 model support
- Does SGLang have a demo for running the VBench dataset accuracy evaluation on Wan2.2?
- test: force torch path in hash_topk remap test on XPU
- Use world rank as bootstrap key for remote instance weight transport …
- [scheduler] fix: stop the queued-request limit from killing retracted requests[optional]
- test(spec): cover speculative TP synchronization contract
- [Bug] Enforce Responses max_tool_calls for built-in tools
- fix(epd): bound pending encoder requests
- fix(epd): terminate encoder workers on shutdown
- Docs
- Python not yet supported