deepspeed
https://github.com/microsoft/deepspeed
Python
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported21 Subscribers
Add a CodeTriage badge to deepspeed
Help out
- Issues
- Record the initial lr in OneCycle so get_last_lr works before step
- [BUG] Launcher crashes with IndexError when --exclude removes every slot
- Reject an --exclude that leaves no slots to launch on
- Keep each param group's beta2 in OneCycle
- {{ env.GITHUB_WORKFLOW }} CI test failure
- Inference layer_norm / rms_norm kill the process (SIGFPE) on an empty batch
- Return early from inference norm launchers when rows == 0
- AutoEP: opt-in skip of the recomputed DeepEP combine
- Count every pipeline stage in the fp32 gradient-clipping norm
- Fix HybridEngine generation with inference tensor parallelism
- Docs
- Python not yet supported