frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

The vLLM detour (a2b39b1, same day) is retired: the Q4_K_M llama.cpp setup
is the requested shape and the vLLM KV-quant options on sm_86 all measured
dead (fp8 hardware-impossible, int8 page-size unification, turboquant
mm-prefix). Root unit restored, vLLM quadlet/Dockerfile/fetch script moved
to .AGENTTRASH, runbook listed as same-day-reverted. Rollback target:
frank-small-vllm-gemma4.
This commit is contained in:
Frank committed 2026-09-19 01:42:37 -07:00
1 parent bab8f7f839
commit 374041cd7a
15 files changed
+495 -637

No files matched your search

+2 -4
View File
@@ -64,8 +64,7 @@ REMOTE_DEPLOY="$REPO_ROOT/scripts/deploy-remote.sh"
@test "the small endpoint is Dankclaw's again, and Dankserver's copy stays retired" {
run python3 "$PLANNER" --target dankclaw --paths \
dankclaw/frank-small/quadlet/frank-small.container scripts/frank-small.env \
scripts/serve-frank-small.sh scripts/download-frank-small-vllm.sh
scripts/frank-small.env scripts/frank-small.service scripts/serve-frank-small.sh
[ "$status" -eq 0 ]
[ "$output" = "frank-small" ]
@@ -73,8 +72,7 @@ REMOTE_DEPLOY="$REPO_ROOT/scripts/deploy-remote.sh"
# that name was retired with the FreeToken runtime on 2026-09-15 and must
# not come back through a planner mapping.
run python3 "$PLANNER" --target dankserver --paths \
dankclaw/frank-small/quadlet/frank-small.container scripts/frank-small.env \
scripts/serve-frank-small.sh scripts/download-frank-small-vllm.sh
scripts/frank-small.env scripts/frank-small.service scripts/serve-frank-small.sh
[ "$status" -eq 0 ]
[ -z "$output" ]
}