tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-04-02 05:35:19 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update BACKLITE.md

Browse Source
This commit is contained in:
Shlomtz 2026-03-12 11:01:41 +03:00 committed by GitHub
parent 2a8c423150
commit 8cadf88faf
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
dev/BACKLITE.md
View File

@ -13,7 +13,7 @@ uv pip install --no-build-isolation BackLite/hopper/
### Launch a BackLite training run
Pass `--backlite-negl-prob` to `base_train`:
Pass `--backlite-negl-prob` and `--negl-prob-warmup-steps` to `base_train`:
```bash
OMP_NUM_THREADS=1 torchrun --standalone --nproc_per_node=8 -m scripts.base_train -- \
@ -21,7 +21,8 @@ OMP_NUM_THREADS=1 torchrun --standalone --nproc_per_node=8 -m scripts.base_train
--run="d24-backlite" \
--model-tag="d24_backlite" \
--fp8 \
--backlite-negl-prob=0.1
--backlite-negl-prob=0.1 \
--negl-prob-warmup-steps=100
```
You should see `✓ BackLite enabled, negl_prob=0.1` in the output.