deepspeed
https://github.com/microsoft/deepspeed
Python
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported20 Subscribers
Add a CodeTriage badge to deepspeed
Help out
- Issues
- [REQUEST] Dynamic/Adaptive Prefetching Window for ZeRO-3
- Clarify merge commit exemption for signoff check in AGENTS.md and CLAUDE.md
- Remove redundant DCO workflow
- Derive AutoEP rank splits from the per-expert count exchange
- Enable ZeRO-3 linear wrapper for existing models
- Add keyword argument support to activation checkpointing
- Wiring up offload_opt_states
- [AutoTP] Preserve universal checkpoint metadata for HuggingFace tp_plan
- [REQUEST] Unmanaged gradient accumulation: let callers own the optimizer-step boundary
- Docs
- Python not yet supported