tacit

tacit synced commits to refs/pull/93/merge at tacit/nanochat from mirror 2026-01-12 22:43:45 +00:00

6c7311df6d Merge 7950813a41 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/429/merge at tacit/nanochat from mirror 2026-01-12 22:43:45 +00:00

a8ada75361 Merge 48aaa4b3df into 4610a838a1

48aaa4b3df Download the minimum number of parquet shards to train the tokenizer reproducibly

Compare 2 commits »

tacit synced commits to refs/pull/414/merge at tacit/nanochat from mirror 2026-01-12 22:43:44 +00:00

a13c1a050b Merge 57bcf6786e into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/407/merge at tacit/nanochat from mirror 2026-01-12 22:43:44 +00:00

cd035bfb7a Merge 47885e743b into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/425/merge at tacit/nanochat from mirror 2026-01-12 22:43:44 +00:00

fe620659c0 Merge eebab89a11 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/412/merge at tacit/nanochat from mirror 2026-01-12 22:43:44 +00:00

a01491492a Merge db5e62fc2a into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/409/merge at tacit/nanochat from mirror 2026-01-12 22:43:44 +00:00

202201be40 Merge 489075bdbd into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/151/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

767771179c Merge 7f3154f025 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/324/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

83f25c3f4f Merge e00c73322c into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/141/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

7d0a1d83b2 Merge c79559674b into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/328/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

7b5f5d1efa Merge 02b22a5a13 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

b33e394528 oops actually make SSSL the default window pattern

Compare 19 commits »

tacit synced commits to refs/pull/370/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

821d13d467 Merge 9a9b12b1be into 4610a838a1

4610a838a1 record negative result on MTP

Compare 2 commits »

tacit synced commits to refs/pull/396/merge at tacit/nanochat from mirror 2026-01-12 22:43:43 +00:00

98289fb64e Merge 7f6219e092 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/433/merge at tacit/nanochat from mirror 2026-01-12 14:33:50 +00:00

7949acba75 Merge c0618a6b7e into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/59/merge at tacit/nanochat from mirror 2026-01-12 14:33:50 +00:00

d92ca71ecb Merge 23393eae83 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/312/merge at tacit/nanochat from mirror 2026-01-12 14:33:49 +00:00

5a6f298aa5 Merge 26b0941f75 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

b33e394528 oops actually make SSSL the default window pattern

Compare 22 commits »

tacit synced commits to refs/pull/399/merge at tacit/nanochat from mirror 2026-01-12 14:33:49 +00:00

1d061f5631 Merge de50af6283 into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

b33e394528 oops actually make SSSL the default window pattern

Compare 10 commits »

tacit synced commits to refs/pull/429/merge at tacit/nanochat from mirror 2026-01-12 14:33:49 +00:00

a6f9003374 Merge b510e6648e into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

Compare 4 commits »

tacit synced commits to refs/pull/400/merge at tacit/nanochat from mirror 2026-01-12 14:33:49 +00:00

ae9c1b0d99 Merge 32ce342c88 into 4610a838a1

4610a838a1 record negative result on MTP

Compare 2 commits »

tacit synced commits to refs/pull/311/merge at tacit/nanochat from mirror 2026-01-12 14:33:48 +00:00

0f2e5bf83d Merge 81a958350a into 4610a838a1

4610a838a1 record negative result on MTP

21608ec51e allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway

aa95fb2e03 make miniseries more generic and easier to run and less hard coded

b33e394528 oops actually make SSSL the default window pattern

Compare 22 commits »