Commit Graph

4 Commits

Author SHA1 Message Date
MadMax129
0a1059d571 add into rustbpe 2025-10-24 18:52:26 -04:00
MadMax129
12f418f0a1 faster regex in C 2025-10-23 16:59:10 -04:00
Andrej Karpathy
9467d83cf2 fix memory leak bug in rust tokenizer ty @mitsuhiko 2025-10-19 23:54:31 +00:00
karpathy
3a5e0bc50b initial commit 2025-10-13 06:49:24 -07:00