tacit
0 Followers · 0 Following
  • Joined on 2024-05-31
Repositories
4
 Projects Packages Public Activity Starred Repositories
tacit synced commits to refs/pull/574/merge at tacit/nanochat from mirror 2026-03-05 00:40:43 +00:00
565efcf858 Merge e009166646 into 752abc836e
752abc836e Ensure that inputs and targets are contiguous (#569)
4b4077425b Document new Leaderboard entry congrats @ddudek for pointing out ClimbMix, time to GPT-2 is now 2.01 hours, down from 2.76 previously
324e69c45d big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise
Compare 4 commits »
tacit synced commits to refs/pull/555/merge at tacit/nanochat from mirror 2026-03-05 00:40:38 +00:00
898345a322 Merge 2566b19e41 into 4b4077425b
4b4077425b Document new Leaderboard entry congrats @ddudek for pointing out ClimbMix, time to GPT-2 is now 2.01 hours, down from 2.76 previously
324e69c45d big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise
Compare 3 commits »
tacit synced commits to refs/pull/544/merge at tacit/nanochat from mirror 2026-03-05 00:40:37 +00:00
ffa10789eb Merge 767df6ef61 into 4b4077425b
4b4077425b Document new Leaderboard entry congrats @ddudek for pointing out ClimbMix, time to GPT-2 is now 2.01 hours, down from 2.76 previously
324e69c45d big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 5 commits »
tacit synced commits to master at tacit/nanochat from mirror 2026-03-05 00:40:35 +00:00
1076f97059 delete autocast, an unnecessary thorn in my side, manage dtypes directly
752abc836e Ensure that inputs and targets are contiguous (#569)
4b4077425b Document new Leaderboard entry congrats @ddudek for pointing out ClimbMix, time to GPT-2 is now 2.01 hours, down from 2.76 previously
324e69c45d big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise
Compare 4 commits »
tacit synced and deleted reference refs/tags/refs/pull/569/merge at tacit/nanochat from mirror 2026-03-05 00:40:34 +00:00
tacit synced and deleted reference refs/tags/refs/pull/563/merge at tacit/nanochat from mirror 2026-03-05 00:40:34 +00:00
tacit synced and deleted reference refs/tags/refs/pull/545/merge at tacit/nanochat from mirror 2026-03-05 00:40:32 +00:00
tacit synced commits to refs/pull/576/merge at tacit/nanochat from mirror 2026-03-04 16:30:30 +00:00
e2d5f2b7af Merge e19b8b8fe1 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/580/merge at tacit/nanochat from mirror 2026-03-04 16:30:30 +00:00
fcb1bc3d11 Merge 16755495bc into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »
tacit synced commits to refs/pull/574/merge at tacit/nanochat from mirror 2026-03-04 16:30:29 +00:00
4623f5e6b6 Merge e009166646 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/573/merge at tacit/nanochat from mirror 2026-03-04 16:30:29 +00:00
2731a4e78f Merge ec06564b46 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/568/merge at tacit/nanochat from mirror 2026-03-04 16:30:29 +00:00
d7c0a91720 Merge 212bdae120 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/545/merge at tacit/nanochat from mirror 2026-03-04 16:30:29 +00:00
6ca67b654a Merge 2277da9ff4 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/533/merge at tacit/nanochat from mirror 2026-03-04 16:30:28 +00:00
17337afc94 Merge 6e9ef8f565 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »
tacit synced commits to refs/pull/551/merge at tacit/nanochat from mirror 2026-03-04 08:20:28 +00:00
b304362422 Merge a5bbc67960 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »
tacit synced commits to refs/pull/579/merge at tacit/nanochat from mirror 2026-03-04 08:20:28 +00:00
e6363b157b Merge be723b7afb into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »
tacit synced commits to refs/pull/509/merge at tacit/nanochat from mirror 2026-03-04 08:20:28 +00:00
90a766727d Merge 9caf6690a1 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 4 commits »
tacit synced commits to refs/pull/569/merge at tacit/nanochat from mirror 2026-03-04 00:10:39 +00:00
3a998fccf5 Merge da507c5835 into 83dccc20ae
83dccc20ae Restore completion-only loss masking in SFT dataloader (#582)
Compare 2 commits »
tacit synced commits to refs/pull/555/merge at tacit/nanochat from mirror 2026-03-04 00:10:39 +00:00
24778c261d Merge 2566b19e41 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »
tacit synced commits to refs/pull/526/merge at tacit/nanochat from mirror 2026-03-04 00:10:38 +00:00
a1e639b63e Merge 4f79e750e7 into b07604ebaa
b07604ebaa document the legacy fineweb100b dataset and the new climbmix400b dataset
aba30cb037 tune logit softcap?
Compare 3 commits »