llm.c
https://github.com/karpathy/llm.c
Cuda
LLM training in simple, raw C/CUDA
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Cuda not yet supported2 Subscribers
Add a CodeTriage badge to llm.c
Help out
- Issues
- log with LINE and FILE for better addressing.
- add llama 3 support to llm.c
- Add SwiGLU support - llama3 feature branch
- Update download_starter_pack.sh
- Will this repo update new documentation later?
- FP8 with Tensor Reorg
- -pm -> -pi: typo in error_usage
- Question concerning `float4`
- Activation Checkpointing for Llama3 branch
- Online Softmax is wrong
- Docs
- Cuda not yet supported