• Joined on 2024-05-31
tacit synced commits to refs/pull/151/merge at tacit/nanochat from mirror 2026-02-06 18:49:49 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/328/merge at tacit/nanochat from mirror 2026-02-06 18:49:49 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/486/merge at tacit/nanochat from mirror 2026-02-06 10:39:49 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 8 commits »
tacit synced commits to refs/pull/437/merge at tacit/nanochat from mirror 2026-02-06 10:39:48 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/442/merge at tacit/nanochat from mirror 2026-02-06 10:39:48 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/501/merge at tacit/nanochat from mirror 2026-02-06 02:29:54 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 6 commits »
tacit synced commits to master at tacit/nanochat from mirror 2026-02-06 02:29:53 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
f41dd3cbd7 auto-calculate optimal batch size. the original setting of 0.5M was only optimal for d12, but d26 prefers 1M and so on
Compare 5 commits »
tacit synced commits to refs/pull/492/merge at tacit/nanochat from mirror 2026-02-06 02:29:53 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/483/merge at tacit/nanochat from mirror 2026-02-06 02:29:53 +00:00
e527521a3f briefly mention batch ramp experimentation too, too weak to merge in my few attempts
96522798f1 docs docs docs
5fdd5cdb24 new leaderboard record via new auto-calculated optimal batch size. for d26 it is 1M, up from 0.5M that was default earlier
2c062aaa94 nit: don't mutate args, create new var for total_batch_size
Compare 9 commits »
tacit synced commits to refs/pull/501/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
98eed6df18 bring back an assert guarding against bad param sizing
012da1a78b Typo fixes (#480)
75b302f331 fix hash commit on leaderboard and a paragraph clarification
Compare 4 commits »
tacit synced commits to master at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
98eed6df18 bring back an assert guarding against bad param sizing
012da1a78b Typo fixes (#480)
75b302f331 fix hash commit on leaderboard and a paragraph clarification
Compare 3 commits »
tacit synced commits to refs/pull/486/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
75b302f331 fix hash commit on leaderboard and a paragraph clarification
Compare 2 commits »
tacit synced and deleted reference refs/tags/refs/pull/480/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
tacit synced and deleted reference refs/tags/refs/pull/93/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
tacit synced commits to refs/pull/498/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
98eed6df18 bring back an assert guarding against bad param sizing
012da1a78b Typo fixes (#480)
75b302f331 fix hash commit on leaderboard and a paragraph clarification
Compare 4 commits »
tacit synced and deleted reference refs/tags/refs/pull/496/merge at tacit/nanochat from mirror 2026-02-05 18:19:50 +00:00
tacit synced commits to refs/pull/501/merge at tacit/nanochat from mirror 2026-02-05 10:10:02 +00:00
1144d186ed try and fail relu^2 -> swiglu
d63b7ab9ac try and fail relu^2 -> swiglu
Compare 3 commits »
tacit synced commits to refs/pull/498/merge at tacit/nanochat from mirror 2026-02-05 10:10:02 +00:00
1144d186ed try and fail relu^2 -> swiglu
d63b7ab9ac try and fail relu^2 -> swiglu
Compare 3 commits »
tacit synced commits to refs/pull/486/merge at tacit/nanochat from mirror 2026-02-05 10:10:01 +00:00
1144d186ed try and fail relu^2 -> swiglu
d63b7ab9ac try and fail relu^2 -> swiglu
Compare 3 commits »
tacit synced commits to refs/pull/496/merge at tacit/nanochat from mirror 2026-02-05 10:10:01 +00:00
1144d186ed try and fail relu^2 -> swiglu
d63b7ab9ac try and fail relu^2 -> swiglu
Compare 3 commits »