transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported55 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- Should Trainer support models FSDP2-sharded at load time (DistributedConfig(fsdp_size=N))?
- Add native TR-HASH model support
- [Umbrella] FSDP2 + expert-parallel token dispatch, with sharded-loading prefetch
- AutoTokenizer silently corrupts deepseek-math-7b-rl in 5.x: encode strips all spaces, decode emits literal byte-level markers
- Fix LlamaTokenizer overwriting pre_tokenizer and decoder from tokenizer.json
- Deprecate backend="torchaudio" for `load_audio`
- DisentangledFlash: fused Triton attention for DeBERTa-v2/v3
- Support per-layer cache configuration and attention-mask selection
- Persist the Whisper spelling normalizer across save_pretrained
- Feat/laguna quantized checkpoints support
- Docs
- Python not yet supported