mirror of
https://github.com/karpathy/nanochat.git
synced 2026-05-08 00:39:50 +00:00
Previous text-stream approach lost markers because BPE partial-byte tokens decode to empty strings, so assistant_text never accumulated the full marker. Switch to matching the ordinary-token id sequence directly (python_start = [60,124,25145,95,17104,124,62]). |
||
|---|---|---|
| .. | ||
| _model.py | ||
| _tokenizer.py | ||
| _tools.py | ||
| serve.py | ||