tacit
0 Followers · 0 Following
  • Joined on 2024-05-31
Repositories
4
 Projects Packages Public Activity Starred Repositories
tacit synced and deleted reference refs/tags/refs/pull/706/merge at tacit/nanochat from mirror 2026-04-14 21:08:22 +00:00
tacit synced commits to refs/pull/644/merge at tacit/nanochat from mirror 2026-04-14 21:08:22 +00:00
a7a67bf8de Merge 5c92dd02cb into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 19 commits »
tacit synced commits to refs/pull/690/merge at tacit/nanochat from mirror 2026-04-14 21:08:22 +00:00
44a7a4a47b Merge 9bc9e8ca19 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/662/merge at tacit/nanochat from mirror 2026-04-14 12:58:35 +00:00
0fd70f900d Merge 55eb345515 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 7 commits »
tacit synced commits to refs/pull/702/head at tacit/nanochat from mirror 2026-04-14 12:58:35 +00:00
275fa4b060 using non kv value to fix c_proj shape error.
9d852177a9 fix shape mismatch and account for gqa.
Compare 2 commits »
tacit synced commits to refs/pull/702/merge at tacit/nanochat from mirror 2026-04-14 12:58:35 +00:00
bfe68455e0 Merge 275fa4b060 into b9b6ce137b
275fa4b060 using non kv value to fix c_proj shape error.
9d852177a9 fix shape mismatch and account for gqa.
Compare 3 commits »
tacit synced commits to refs/pull/655/merge at tacit/nanochat from mirror 2026-04-14 12:58:34 +00:00
3f270b5fb6 Merge 741e54f360 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/706/merge at tacit/nanochat from mirror 2026-04-14 04:48:26 +00:00
9bc12414c4 Merge 12839c11e3 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/707/merge at tacit/nanochat from mirror 2026-04-14 04:48:26 +00:00
1908b371cb Merge 309d8a0f15 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/695/merge at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
7547bdd458 Merge 7b4549495c into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/694/merge at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
6fe22d0874 Merge 758af69e25 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/702/merge at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
a0f7bfea16 Merge 6eedfa188c into b9b6ce137b
6eedfa188c Merge branch 'karpathy:master' into Exclusive-Self-Attention
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
Compare 6 commits »
tacit synced commits to refs/pull/692/merge at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
adc7a4f632 Merge 6c1322e4ce into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/693/merge at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
5f230b484d Merge e9b44f62c2 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/702/head at tacit/nanochat from mirror 2026-04-14 04:48:25 +00:00
6eedfa188c Merge branch 'karpathy:master' into Exclusive-Self-Attention
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/646/merge at tacit/nanochat from mirror 2026-04-14 04:48:24 +00:00
e44e9b3039 Merge 9d62998d3a into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 22 commits »
tacit synced commits to refs/pull/611/merge at tacit/nanochat from mirror 2026-04-14 04:48:24 +00:00
eac792628b Merge ac5927e158 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/682/merge at tacit/nanochat from mirror 2026-04-14 04:48:24 +00:00
bdb28520de Merge f29051afc6 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/540/merge at tacit/nanochat from mirror 2026-04-14 04:48:24 +00:00
cf11d7b042 Merge d343c939c0 into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »
tacit synced commits to refs/pull/691/merge at tacit/nanochat from mirror 2026-04-14 04:48:24 +00:00
0b6620e30d Merge 322eb6b86b into b9b6ce137b
b9b6ce137b Merge pull request #686 from marcinbogdanski/fix/init-smear-backout-lambdas
a3ca42a678 add comment
9822cc7424 use nn.init and initialize smear gate's weight as well
94b73ad29a fix: initialize smear and backout lambdas in init_weights
Compare 5 commits »