tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-04-02 21:55:14 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

turn tokenizer train back on

Browse Source
This commit is contained in:
Sushrut Karnik 2026-03-13 00:07:06 +01:00
parent fcc4de7b96
commit bf19cb325c
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
runs/runcpu.sh
View File

@ -31,10 +31,9 @@ if [ -z "$WANDB_RUN" ]; then
fi
# train tokenizer on ~2B characters (~34 seconds on my MacBook Pro M3 Max)
# python -m nanochat.dataset -n 8
# python -m scripts.tok_train --max-chars=2000000000
python -m nanochat.dataset -n 8
python -m scripts.tok_train --max-chars=2000000000
python -m scripts.tok_eval
# Target directory: /Users/sushrutkarnik_1/.cache/nanochat/base_data_climbmix
# train a small 4 layer model
# I tuned this run to complete in about 30 minutes on my MacBook Pro M3 Max.