frank-small: llama.cpp -> vLLM (gemma-4-12B-it-qat-w4a16-ct, w4a16 Marlin)

Runtime swap on the RTX 3090 (port 7771):
- vLLM gemma-x86_64-cu129 dev build, digest-pinned, audio extra pip-installed
  into localhost/vllm/vllm-openai:frank-small (Dockerfile, no COPY lines)
- google/gemma-4-12B-it-qat-w4a16-ct (10.26 GiB int4) + Google's bf16 MTP
  assistant (845 MB) — the w4a16-ct assistant cannot draft in vLLM (drafter
  path skips Marlin; acceptance 1.00), bf16 measures 2.80-3.56
- root systemd unit -> rootless Quadlet (dankclaw/frank-small/quadlet/);
  manual CUDA device+lib mounts (no nvidia-container-toolkit on host)
- bf16 KV (fp8 hardware-dead on sm_86), 289,647-token pool, 2 concurrent
  full-context sessions, CUDA graphs on
- native text+image+audio: the fleet's multimodal endpoint
- measured: pp@67k 1293 t/s, pp@213k 608 t/s, tg@213k ~13.6 t/s,
  tg@85k ~17.6 t/s
- host driver 610.57.04 (Ubuntu 26.04); sm_86 is correct, no arch override
- planner/scoping: frank-small now selected by dankclaw/frank-small/ +
  env/serve/download trio; old unit retired to scripts/.AGENTTRASH/
- docs: new runbook frank-small-vllm-gemma4.md; AGENTS.md, LLM index,
  top docs index updated; old runbook moved to retired

serverAppConfigs-docs/LLM/index.md

@@ -5,9 +5,9 @@ Documentation for the LLM inference fleet on the two hosts (2026-09-16):
 process across both Radeon AI PRO R9700 cards (ajgazin Swift-Qwen3.8-27B-
 Uncensored-Dynamic-MTP UD-Q8_K_XL + the z-lab DFlash2 drafter), and TWO
 endpoints on Dankclaw — halogen-flash-server (frank-large, Qwen3.8-Flash-Next
-w4b on the gfx1151 iGPU, port 7770) and mainline llama.cpp (frank-small,
-ISTA-DASLab Qwen3.8-27B-GSQ-RCO IQ3_S with MTP and vision on the RTX 3090, port
-7771).
+w4b on the gfx1151 iGPU, port 7770) and vLLM (frank-small,
+google/gemma-4-12B-it-qat-w4a16-ct with the bf16 MTP assistant on the RTX
+3090, port 7771).
 
 > 2026-08-22: the former `vllmScripts` repository is merged into the
 > serverAppConfigs repository. This knowledge base moved from the old repo's
@@ -35,10 +35,10 @@ gfx1151 iGPU 64 GiB unified memory]
 frank-large, port 7770]
         F[peonist-ai Qwen3.8-Flash-Next w4b
 2 x 200192 ctx over one 400384-position pool]
-        G[mainline llama.cpp 37b53fd
+        G[vLLM gemma-x86_64-cu129
 frank-small, port 7771]
-        H[Qwen3.8-27B GSQ-RCO IQ3_S
-131072 ctx / 1 slot, MTP + vision]
+        H[gemma-4-12B-it-qat-w4a16-ct
+262144 ctx / 2 full-context sessions, MTP + vision + audio]
         E2 --> E --> F
         E2 --> G --> H
     end
@@ -87,11 +87,15 @@ frank-small, port 7771]
   overlay) on the gfx1151 iGPU — two 200k conversations over one
   400,384-position pool, deployed flags, memory model, client contract,
   troubleshooting
-- [[frank-small-gemma4-12b]] — ACTIVE frank-small runbook since 2026-09-17
-  (root systemd unit, port 7771): mainline llama.cpp serving
-  HauhauCS/Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced Q4_K_M on the RTX
-  3090, with the separate MTP assistant sidecar chained behind ngram-mod,
-  q8_0 KV, and `--fit` sizing the full 262k window into ~12 GiB
+- [[frank-small-vllm-gemma4]] — ACTIVE frank-small runbook since 2026-09-19
+  (rootless Quadlet, port 7771): vLLM serving
+  google/gemma-4-12B-it-qat-w4a16-ct (compressed-tensors w4a16, Marlin)
+  with Google's bf16 MTP assistant on the RTX 3090 — bf16 KV, 289,647-token
+  pool, 2 concurrent full-context sessions, native text+image+audio
+- [[frank-small-gemma4-12b]] — RETIRED 2026-09-19 (rollback target): the
+  prior frank-small runbook (2026-09-17 → 09-19), mainline llama.cpp serving
+  HauhauCS Gemma4-12B-QAT-Uncensored Q4_K_M with the MTP sidecar, q8_0 KV,
+  4 slots of 262k
 - [[frank-small-qwen38-gsq-rco]] — RETIRED 2026-09-17 (rollback target): the
   prior frank-small runbook (2026-09-16 → 09-17), ISTA-DASLab
   Qwen3.8-27B-GSQ-RCO IQ3_S with the model's own in-file MTP head and