nanochat is Andrej Karpathy’s capstone project for LLM101n by Eureka Labs.
It’s a full-stack LLM implementation in ~1000 lines of clean, hackable code (Python, Rust, HTML, Shell).
You can run the entire pipeline—tokenization, pretraining, finetuning, evaluation, inference, and web UI—on a single 8XH100 node for under $1000.
It achieves competitive performance (~4e19 FLOPs, $100 tier model) without massive frameworks.
Its purpose is to make LLMs accessible and understandable for developers who want to learn by doing!
About the Author
