tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-01-26 13:24:31 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix condition to perform bpb evaluation (#324)

Browse Source 
Co-authored-by: svlandeg <svlandeg@github.com>
This commit is contained in:
Nitish Pandey 2026-01-17 08:26:43 +05:30 committed by GitHub
parent e1dafc510f
commit f42ae9e901
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
scripts/mid_train.py
View File

@ -249,7 +249,7 @@ while True:
last_step = bool(last_step_tensor.item())
# once in a while: evaluate the val bpb (all ranks participate)
if args.eval_every > 0 and (last_step or step % args.eval_every == 0):
if last_step or (args.eval_every > 0 and step % args.eval_every == 0):
model.eval()
val_loader = build_val_loader()
eval_steps = args.eval_tokens // (args.device_batch_size * args.max_seq_len * ddp_world_size)