transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported54 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- Mamba (Mamba-1): forward of several tokens over a primed cache restarts the selective scan from zero and returns wrong logits
- Split KV-sharing and rope attention variants into per-layer classes
- fsdp_config["ignored_modules"] is silently ignored by TrainingArguments
- [serge] Fix 5 integration tests for model `qwen3_vl_moe` failing with `other`, raising `RuntimeError` (other (5))
- [serge] Fix 2 integration tests for model `ministral` failing with `output_mismatch` (tensor values differ (2))
- [serge] Fix 2 integration tests for model `qwen3_vl_moe` failing with `OOM`, raising `OutOfMemoryError` (other (2))
- [distributed] Save/load benchmark on 8x B200: gathered save, DCP save and consolidation bottlenecks
- Add H-Net
- Qwen4Exp QSA indexer: data-dependent k_layernorm calls deadlock ZeRO-3 training
- v1/audio/transcription refresh
- Docs
- Python not yet supported