frank-large: hand vLLM the CONTAINER model path; link the new runbook
The first crash-looping boot (51 restarts): serve received the host path /home/dank/models/... but the models tree is mounted at /models inside the container, so transformers failed 'Repo id must be in the form namespace/repo_name' before the engine even built. Same conversion the spec draft already used. Pinned by bats. Root docs index links the new runbook (seam required it) and the work log records the crash-loop plus the 52 G payload reclaim.
This commit is contained in:
1 parent
de383fe53e
commit
780c307354
4 files changed
+39
-11
No files matched your search
@@ -109,6 +109,12 @@ FETCH_MTPSRC="$REPO_ROOT/scripts/download-frank-large-qwen35.sh"
|
||||
grep -q -- '--dtype bfloat16' "$SERVE"
|
||||
grep -q -- '--trust-remote-code' "$SERVE"
|
||||
grep -q -- '--ulimit memlock=-1:-1' "$SERVE"
|
||||
# vllm runs INSIDE the container: the model path handed to `serve` is
|
||||
# the /models mount path, never the host path (2026-10-01: the host
|
||||
# path crash-looped 51 times on "Repo id must be in the form…").
|
||||
grep -q 'serve "$MODEL_CONTAINER_DIR"' "$SERVE"
|
||||
grep -q 'MODEL_CONTAINER_DIR="/models/' "$SERVE"
|
||||
! grep -qE '^\s+serve "\$FRANK_LARGE_MODEL_DIR"' "$SERVE"
|
||||
}
|
||||
|
||||
@test "speculative decode is cross-model MTP BY MEASUREMENT" {
|
||||
|
||||
Reference in new issue
Block a user