unsalgokdag
|
8695280566
|
speed up CORE metric evaluation: batched GPU forward passes, threaded CPU prep, cross-call caching. first eval pipelines tokenization on a background thread while GPU processes the previous batch. second+ evals skip tokenization and collation entirely, only GPU forward passes remain. Also adds a benchmark script to sweep batch_size and queue_size hyperparameters.
|
2026-02-12 18:13:56 +01:00 |
|
Andrej Karpathy
|
8ebc14b348
|
small touchups to the eval script, re-order items etc, cosmetic
|
2026-02-03 21:03:42 +00:00 |
|
Andrej Karpathy
|
0307997f9b
|
merge two files base_loss and base_eval into a single file, it's nicer this way, and unify the huggingface code associated with both
|
2026-02-01 02:36:43 +00:00 |
|
DU Wenjie
|
ea4229851b
|
bugfix
|
2025-12-26 19:02:12 +08:00 |
|
DU Wenjie
|
7840049189
|
bugfix keep same args style in scripts/base_eval.py
|
2025-12-26 17:29:08 +08:00 |
|
duwenjie
|
92c6654b95
|
bugfix save and load ckpt from model_tag dir
|
2025-12-21 15:07:04 +08:00 |
|
svlandeg
|
c72b8b2309
|
add explicit UTF-8 encoding
|
2025-11-03 21:27:12 +01:00 |
|
Dipesh Babu
|
226953b841
|
fix: open JSONL and results CSV with UTF-8 encoding for portability
|
2025-11-03 01:20:56 -05:00 |
|
Andrej Karpathy
|
cf587acb1a
|
move eval bundle download to be lazy and inside the python code so that we can substantially simplify the run bash scripts
|
2025-11-01 16:04:38 +00:00 |
|
Andrej Karpathy
|
7d2c4a3d95
|
delete pandas dep in base_eval use csv instead
|
2025-11-01 15:28:30 +00:00 |
|
svlandeg
|
8c9b004c99
|
typo fixes in scripts
|
2025-10-28 20:17:31 +01:00 |
|
karpathy
|
df600b6ed5
|
many small tweaks. base, eval, core work now i think
|
2025-10-16 15:46:18 -07:00 |
|
karpathy
|
786119d593
|
add autodetect of device and related stuff. getting weird warnings/errors still, so wip
|
2025-10-16 10:26:19 -07:00 |
|
karpathy
|
3a5e0bc50b
|
initial commit
|
2025-10-13 06:49:24 -07:00 |
|