Fix AMD ROCm install regression in speedrun.sh

Explicitly pass `--extra $EXTRAS` to `uv run` when building the tokenizer.
This prevents `uv` from reverting to the default (NVIDIA) dependency set
during the `maturin` build step, ensuring the correct PyTorch version
(ROCm) is preserved on AMD hardware.
This commit is contained in:
google-labs-jules[bot] 2025-11-23 02:33:07 +00:00
parent dd37f29fe4
commit 83bb650b49
2 changed files with 227 additions and 711 deletions

View File

@ -67,7 +67,7 @@ curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y
source "$HOME/.cargo/env"
# Build the rustbpe Tokenizer
uv run maturin develop --release --manifest-path rustbpe/Cargo.toml
uv run --extra $EXTRAS maturin develop --release --manifest-path rustbpe/Cargo.toml
# Download the first ~2B characters of pretraining dataset
# look at dev/repackage_data_reference.py for details on how this data was prepared

936
uv.lock

File diff suppressed because it is too large Load Diff