transformers
https://github.com/huggingface/transformers
Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported54 Subscribers
Add a CodeTriage badge to transformers
Help out
- Issues
- [`distributed`] `DistributedConfig(cp_size=N)`
- [`distributed`] Run the context parallel tests on every causal LM
- [`distributed`] Context parallelism with tensor parallelism
- [`distributed`] Context parallelism with expert parallelism
- [`distributed`] Context parallelism: pad the sequences to a multiple of `cp_size`
- KimiLinear: padding in cached continuation advances convolution and recurrent states
- Raise ValueError for out-of-range float images in convert_to_rgb
- New model addition: Iwin Transformer (Hierarchical Vision Transformer using Interleaved Windows)
- [`distributed`] Checkpoint the layer's `forward`, not `__call__`, so FSDP2 hooks stay outside the checkpoint
- Fix DynamicCache.batch_select_indices for hybrid and linear attention layers
- Docs
- Python not yet supported