frank-large: hand vLLM the CONTAINER model path; link the new runbook

The first crash-looping boot (51 restarts): serve received the host path
/home/dank/models/... but the models tree is mounted at /models inside the
container, so transformers failed 'Repo id must be in the form
namespace/repo_name' before the engine even built. Same conversion the spec
draft already used. Pinned by bats. Root docs index links the new runbook
(seam required it) and the work log records the crash-loop plus the 52 G
payload reclaim.
This commit is contained in:
Frank committed 2026-10-01 19:39:55 -07:00
1 parent de383fe53e
commit 780c307354
4 files changed
+39 -11

No files matched your search

+6
View File
@@ -109,6 +109,12 @@ FETCH_MTPSRC="$REPO_ROOT/scripts/download-frank-large-qwen35.sh"
grep -q -- '--dtype bfloat16' "$SERVE"
grep -q -- '--trust-remote-code' "$SERVE"
grep -q -- '--ulimit memlock=-1:-1' "$SERVE"
# vllm runs INSIDE the container: the model path handed to `serve` is
# the /models mount path, never the host path (2026-10-01: the host
# path crash-looped 51 times on "Repo id must be in the form…").
grep -q 'serve "$MODEL_CONTAINER_DIR"' "$SERVE"
grep -q 'MODEL_CONTAINER_DIR="/models/' "$SERVE"
! grep -qE '^\s+serve "\$FRANK_LARGE_MODEL_DIR"' "$SERVE"
}
@test "speculative decode is cross-model MTP BY MEASUREMENT" {