transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported54 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- [Decision] Add native D1 Omni with modular components and training loss
- Packed sequences silently leak attention and training gradients when use_cache=True initializes an empty KV cache
- CI: install OpenVINO and NNCF in the daily GPU image
- `GradientCheckpointingLayer` checkpoints FSDP2 hooks; `use_reentrant=True` silently drops gradients when a layer runs more than once per backward
- Deprecate Wav2Vec2ProcessorWithLM and pyctcdecode/kenlm LM decoding
- Tests: skip audio model tests when torchaudio or librosa is missing
- 🚨 Rework slightly subprocessor loading
- [Decision] Add native model-specific training losses
- [Trainer] Support python dataclass objects in _prepare_input
- Continuous batching: find the sharded key/value projections under any decoder path
- Docs
- Python not yet supported