transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported54 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- MiniMax lightning attention: decay recurrence runs in bf16, so slow-decay heads never decay and decode drifts with length
- Add RTDetrForSegmentation and RTDetrV2ForSegmentation
- [WIP] modular cleanup
- [serge] Fix 2 integration tests for model `pvt_v2` failing with `output_mismatch` (tensor values differ (2))
- [serge] Fix 2 integration tests for model `fuyu` failing with `other` (other (2))
- Fix Trainer step accounting when GradScaler skips an optimizer update
- Fix CJK decoding for LlamaTokenizerFast by loading full pipeline from tokenizer.json
- AutoTokenizer with tokenizer_class=LlamaTokenizerFast silently builds a sentencepiece pipeline for a byte-level BPE tokenizer.json, dropping all CJK input
- Trainer counts fp16 steps skipped by GradScaler as completed update steps (`global_step`, `max_steps`, `on_optimizer_step`)
- Rename GradientCheckpointingLayer and supports_gradient_checkpointing to activation checkpointing
- Docs
- Python not yet supported