Add architecture overview section to README and include architecture diagram

This commit is contained in:
Hossein-Lakzaei 2025-10-15 00:42:52 +03:30
parent dd6ff9a1cc
commit d7a9e5d3b2
2 changed files with 10 additions and 0 deletions

View File

@ -4,6 +4,16 @@
> The best ChatGPT that $100 can buy.
---
### Architecture Overview
Heres an overview of the nanochat architecture:
![nanochat architecture](dev/nanochat_architecture.png)
---
This repo is a full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase. nanochat is designed to run on a single 8XH100 node via scripts like [speedrun.sh](speedrun.sh), that run the entire pipeline start to end. This includes tokenization, pretraining, finetuning, evaluation, inference, and web serving over a simple UI so that you can talk to your own LLM just like ChatGPT. nanochat will become the capstone project of the course LLM101n being developed by Eureka Labs.
## Quick start

Binary file not shown.

After

Width:  |  Height:  |  Size: 374 KiB