This commit is contained in:
Hoshj 2026-04-16 20:39:37 -07:00 committed by GitHub
commit 80b306f99d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -6,7 +6,7 @@ The primary metric we care about is "time to GPT-2" - the wall clock time needed
## How to
The script [runs/speedrun.sh](runs/speedrun.sh) always implements the current state of the art on the leaderboard.
The script [runs/speedrun.sh](../runs/speedrun.sh) always implements the current state of the art on the leaderboard.
In practice, I tune the base_train command a little bit. For example, once all the setup is configured and a tokenizer is trained, I like to do something like: