tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-02-06 02:29:53 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Add comment with logits shape

Browse Source
This commit is contained in:
Matěj Kripner 2026-01-03 10:59:14 +01:00 committed by GitHub
parent b7df9f8eaa
commit 3c4be194e9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
nanochat/engine.py
View File

@ -359,7 +359,7 @@ class Engine:
)
else:
logits = self.model.forward(ids, kv_cache=kv_cache_decode)
logits = logits[:, -1, :]
logits = logits[:, -1, :] # (B, vocab_size)
def generate_batch(self, tokens, num_samples=1, **kwargs):
"""