accelerate
https://github.com/huggingface/accelerate
Python
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to accelerate
Help out
- Issues
- Add distributed image captioning example
- docs(operations): add missing docstrings to predicate utility functions
- Fix pad_input_tensors to pad batch to a multiple of num_processes
- SP ulysses native implementation
- fix(utils): don't crash check_os_kernel on non-standard kernel release strings
- [Security] Path traversal + malicious-model DoS via sharded-checkpoint `weight_map` in ….
- `datasets` Iterable Dataset sharding support
- Feature Request: Add API to Materialize Meta Tensors for Device Movement
- Feature request: FSDP2 QLoRA
- [CPU offload hooks] hooks with overlapped transfers and computations
- Docs
- Python not yet supported