peft
https://github.com/huggingface/peft
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
not yet supported1 Subscribers
Add a CodeTriage badge to peft
Help out
- Issues
- Save checkpoint with TP
- Improve DeloRA: add config validation, dedicated tests, and fix typos
- Embeddings LoRA & TP
- Implement import allowlist in AutoPeftModel, limit access in megatron
- Security: Arbitrary Module Import via Malicious Adapter Config (CWE-94)
- Changes for transformers 5 weight conversion
- FSDP + torch.nn.Parameter (MoE layer) lora fine-tuning doesn't work
- Image generation benchmark
- [method_comparison] RL training based method comparison for lora adapters
- WIP: Support tranformers weight conversion
- Docs
- not yet supported