accelerate
https://github.com/huggingface/accelerate
Python
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to accelerate
Help out
- Issues
- SP ulysses native implementation
- [Offloading] Support full disk offloading
- Fix broken documentation links
- Avoid crash on a second epoch over a skip/take IterableDataset
- [bug report] DataSourcesShufflingDisallowed when training using split datasets.IterableDataset
- docs: fix recursively_apply docstring to document test_type instead of nonexistent main_type
- docs: fix parameter names and a ghost entry in docstrings
- fix(utils): don't crash check_os_kernel on non-standard kernel release strings
- Add `materialize_meta_tensors` to reverse `dispatch_model` (#3866)
- Feature Proposal: Add FunASR ASR Distributed Inference Examples
- Docs
- Python not yet supported