optimum
https://github.com/huggingface/optimum
Python
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported2 Subscribers
Add a CodeTriage badge to optimum
Help out
- Issues
- Bump the actions group across 1 directory with 3 updates
- Fix GPTQ CI dependency compatibility
- fix(utils): handle single-token attention mask in random_mask_tensor (#2525)
- fix(utils): infer task from local directory config.json (#2092)
- Infer text2text-generation instead of fill-mask for Bart, mBART and MVP classes
- fix(fx): FuseBiasInLinear must preserve input dtype for float16/bfloat16
- docs: fix AWS Trainium typo (Trainum -> Trainium)
- optimum-cli export openvino cannot infer task from local model directory, even though config.json contains all necessary info
- Preserve shared modules during BatchNorm fusion
- Preserve single-output bias shape when reversing fusion
- Docs
- Python not yet supported