transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported53 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- CodeLlama tokenizer drops leading whitespace on decode round-trip
- skip invalid test cases for inkling tests
- Bump the actions group across 1 directory with 14 updates
- [Mistral] Add native tekken tokenizer support to AutoTokenizer
- [Quantization] Fix CT `apply_quantization_config`
- Raise a clear error when a token is both forced and suppressed
- Transformers 5.13 CPU memory growth loading Qwen3-235B-A22B with DeepSpeed ZeRO-3; 4.51.0 remains bounded
- Fix MistralCommonBackend autodoc source path when mistral-common is missing
- SentencePieceBackend should decode byte-fallback tokens
- [BUG] CANINE: dynamic ONNX export fixes sequence length to example input
- Docs
- Python not yet supported