diff --git a/README.md b/README.md index bc01055..39da38c 100644 --- a/README.md +++ b/README.md @@ -4,6 +4,16 @@ > The best ChatGPT that $100 can buy. +--- + +### Architecture Overview + +Here’s an overview of the nanochat architecture: + +![nanochat architecture](dev/nanochat_architecture.png) + +--- + This repo is a full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase. nanochat is designed to run on a single 8XH100 node via scripts like [speedrun.sh](speedrun.sh), that run the entire pipeline start to end. This includes tokenization, pretraining, finetuning, evaluation, inference, and web serving over a simple UI so that you can talk to your own LLM just like ChatGPT. nanochat will become the capstone project of the course LLM101n being developed by Eureka Labs. ## Quick start diff --git a/dev/nanochat_architecture.png b/dev/nanochat_architecture.png new file mode 100644 index 0000000..e1fe94d Binary files /dev/null and b/dev/nanochat_architecture.png differ