deepspeed
https://github.com/microsoft/deepspeed
Python
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported21 Subscribers
Add a CodeTriage badge to deepspeed
Help out
- Issues
- Add deepspeed.models.minimax_m3_vl: block-sparse attention for MiniMax M3
- Add deepspeed.models.glm_moe_dsa: TileLang sparse attention for GLM-5.2
- [BUG] get_global_grad_norm() returns None with fp32 at ZeRO stage 0
- Record global grad norm when the engine clips fp32 gradients
- Fix FP16 gradient unscaling on loss scale growth steps
- Fused RMSNorm: multi-row programs and a one-pass backward for narrow norms
- Fix autotuning tuner error log that dropped the exception type
- Fix NameError in the MoE socket and machine checkpoint writer
- [MoE] Validate grouped AutoEP top-k routing
- Fix AutoSP tests that expect LLM attention to be wrapped with DistributedAttention
- Docs
- Python not yet supported