tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-06-27 00:19:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

rustbpe: Add Default impl for Tokenizer

Browse Source
This commit is contained in:
Barış Özmen 2025-12-29 04:13:47 +03:00
parent 8f979a8bda
commit 015ce712d7
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
rustbpe/src/lib.rs
View File

@ -256,6 +256,12 @@ impl Tokenizer {
}
}
impl Default for Tokenizer {
fn default() -> Self {
Self::new()
}
}
/// Public methods for the Tokenizer class that will be exposed to Python.
#[pymethods]
impl Tokenizer {