peft
https://github.com/huggingface/peft
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
not yet supported1 Subscribers
Add a CodeTriage badge to peft
Help out
- Issues
- PiSSA / MiCA / CorDA init bypasses quantized-layer guard on 4-bit float-storage layers
- add_weighted_adapter with rank_pattern produces adapters that cannot be reloaded (linear, ties, dare, magnitude_prune)
- TP + LoRA is broken on transformers 5.16: add_tensor_parallel_hooks_to_module and EmbeddingParallel were removed
- FIX get_layer_device_map StopIteration on CPU-only device maps
- [Bug] Prefix tuning crashes for CPU-only device maps
- [RFC, I can do a PR] Make `lora_alpha` a float
- FEAT Add MoE-to-Dense adapter
- ENH Add option to use Khatri-Rao to LoHa
- Implementation for Multi Token Prediction (2507.11851)
- ENH Improve BOFT forward pass, remove CUDA kernel
- Docs
- not yet supported