This commit is contained in:
Hoshj 2026-05-11 14:40:52 -05:00 committed by GitHub
commit c2571559b4
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -6,7 +6,7 @@ The primary metric we care about is "time to GPT-2" - the wall clock time needed
## How to
The script [runs/speedrun.sh](runs/speedrun.sh) always implements the current state of the art on the leaderboard.
The script [runs/speedrun.sh](../runs/speedrun.sh) always implements the current state of the art on the leaderboard.
In practice, I tune the base_train command a little bit. For example, once all the setup is configured and a tokenizer is trained, I like to do something like: