accelerate
https://github.com/huggingface/accelerate
Python
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to accelerate
Help out
- Issues
- docs: add community health files and README updates
- Add per-module fp32 precision for norms under FSDP2
- Expose force_recompute_fp8_weight_in_bwd on AORecipeKwargs
- Fix sequence parallel bool parsing
- Fix megatron_lm bool launch flags parsing "False" as True
- Fix --parallelism_config_sp_seq_length_is_variable parsing "False" as "True"
- [Proposal] HeartFlow - Cognitive Engine for Accelerate
- `--parallelism_config_sp_seq_length_is_variable False` parses as True
- Fix AttributeError when iterating IterableDatasetShard without set_epoch
- ci: pin GitHub Actions to full commit SHAs to prevent supply-chain attacks
- Docs
- Python not yet supported