llm.c
https://github.com/karpathy/llm.c
Cuda
LLM training in simple, raw C/CUDA
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Cuda not yet supported2 Subscribers
Add a CodeTriage badge to llm.c
Help out
- Issues
- FP32 FlashAttention
- Verify vocab is padded before reshaping
- Mapping "py" gpt2 functionalities to match "c"
- A CS 231n-style port of this project, implementing LLMs solely with NumPy
- Update README.md
- FIX TypeError: normal_() got an unexpected keyword argument 'generator' #723
- Dataloader shuffle_rng logic bug under multi-gpu settings?
- Use the command 'brew --prefix libomp' to retrieve the location where libomp would be installed on macOS.
- output is not consistent when I load the gpt2_124M.bin
- Little speed up by simple modification is possible
- Docs
- Cuda not yet supported