Yury Kirpichev 47885e743b Fix WANDB_RUN parameter passing in runcpu.sh ... - Add --run=$WANDB_RUN to base_train, mid_train, and chat_sft calls - Ensures wandb logging works when WANDB_RUN environment variable is set - Matches the behavior in speedrun.sh		2026-01-07 23:25:43 -08:00
..
estimate_gpt3_core.ipynb	add notebook on deriving the CORE estimates for the GPT-3 miniseries.	2026-01-05 18:40:28 +00:00
gen_synthetic_data.py	sane secrets management	2026-01-04 19:29:22 +00:00
generate_logo.html	initial commit	2025-10-13 06:49:24 -07:00
LOG.md	delete grad_clip. appears to not be necessary at all. not only was it buggy because the clipping happened per gpu before grad synchronization, but it costs ~2% MFU, and it also doesn't even help. I tried deleting it a while ago and back then it did help. So I'm guessing that some hyperparameter tuning obviated the reason for it since then	2026-01-08 02:16:50 +00:00
nanochat.png	Update logo	2025-10-14 14:19:44 -04:00
repackage_data_reference.py	initial commit	2025-10-13 06:49:24 -07:00
runcpu.sh	Fix WANDB_RUN parameter passing in runcpu.sh	2026-01-07 23:25:43 -08:00
scaling_analysis.ipynb	add notebook used for scaling laws analysis	2026-01-07 22:28:53 +00:00