tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2025-12-06 12:22:18 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

use orig_model in sampling, silly of me to miss this

Browse Source
This commit is contained in:
Andrej Karpathy 2025-10-20 00:04:15 +00:00
parent 9467d83cf2
commit 2bc521a6de
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
scripts/base_train.py
View File

@ -219,7 +219,7 @@ for step in range(num_iterations + 1):
"My favorite color is", "My favorite color is",
"If 5*x + 3 = 13, then x is", "If 5*x + 3 = 13, then x is",
] ]
engine = Engine(model, tokenizer) engine = Engine(orig_model, tokenizer)
for prompt in prompts: for prompt in prompts:
tokens = tokenizer(prompt, prepend="<|bos|>") tokens = tokenizer(prompt, prepend="<|bos|>")
with autocast_ctx: with autocast_ctx: