vllm
https://github.com/vllm-project/vllm
Python
A high-throughput and memory-efficient inference and serving engine for LLMs
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported60 Subscribers
View all SubscribersAdd a CodeTriage badge to vllm
Help out
- Issues
- [Core][Metrics] Export deferred waiting requests by the reason they were deferred
- [Doc] Add batch-invariance errata for v0.20.0-v0.22.0 compute capability note
- [Bugfix][Frontend] Constrain Qwen3 XML tool calls written without <tool_call>
- [Bugfix][Model] Preserve Dynamic NTK base below the trained context length
- [Bugfix][Kernel][Perf] Honor outer_scale_stride in silu_and_mul_per_block_quant for TMA-aligned transposed scales
- [Feat][2/2] Add Transformers TPSP dense baseline support
- [Feature][KV Connector] Support OFI backend for MORI connector
- [Bugfix][Frontend] Constrain Kimi K3 arguments declared through $ref
- [Bugfix] Qwen Crash: Floor the M-RoPE cache on the served window
- [Model] Support GLM-5.3 MLA DSpark drafts on CUDA
- Docs
- Python not yet supported