This commit is contained in:
Hoshj 2026-04-14 19:26:05 +02:00 committed by GitHub
commit 44a7a4a47b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -6,7 +6,7 @@ The primary metric we care about is "time to GPT-2" - the wall clock time needed
## How to
The script [runs/speedrun.sh](runs/speedrun.sh) always implements the current state of the art on the leaderboard.
The script [runs/speedrun.sh](../runs/speedrun.sh) always implements the current state of the art on the leaderboard.
In practice, I tune the base_train command a little bit. For example, once all the setup is configured and a tokenizer is trained, I like to do something like: