frank-primary: swap Dankserver to llama.cpp Qwen3.8-Flash-Next Q8_0

The 2026-09-26 same-day cutover that ended the Lucebox DS4.1 detour:
Dankserver's :7770 endpoint is now unsloth llama.cpp (the b11030-mix
prebuilt, ROCm gfx120X, bundled runtime) serving
unsloth/Qwen3.8-Flash-Next-GGUF at Q8_0 — 175.30 GiB across six sha256-
verified split parts — on both Radeon AI PRO R9700s, as a ROOT unit (the
frank-large shape: no container, no generated unit).

The deployed contract:

- Placement law: layer split -ts 1,1 with -ngl 999; the routed experts
  and the 51B-param n-gram (PLE) table are COMPUTED in host RAM via
  -ot exps=CPU,ngram_embeddings=CPU (the x4-pair measurement: streaming
  over PCIe loses at 3.7 t/s, computing in RAM does not care).
  per_layer_token_embd.weight=CPU is required by the shared MTP head's
  borrow path (a GPU-resident borrow crashes the draft load).
  mmap stays on; --cache-ram 16384.
- Spec chain draft-mtp,ngram-mod: the shared Q8_0 MTP head
  (mtp-...-shared-Q8_0.gguf, 2,786,568,256 B) at depth 2, with the
  draftless ngram-mod matcher chained behind it — the only legal way to
  layer two spec implementations in one process.
- Vision explicit: --mmproj names the BF16 projector (this build never
  autoloads; a server without it comes up healthy and text-only).
- Reasoning: --reasoning-format deepseek → reasoning_content; the
  Qwen3.8 template's {xhigh, medium, low} reasoning_effort gate folded
  by reasoningEffortMap in models.yml.
- One stream, the model's full 262,144 context; greedy server default
  with Qwen-recommended sampling riding compat.extraBody.

The deployer's deploy_llm_primary is rewritten for the root unit: it
gates every artifact at its declared byte count (stat -c %s, never wc -c
— which read the whole 377 GiB lucebox file for minutes on 2026-09-26),
retires the lucebox user quadlet to dated home trash, waits out port
7770, relinks/enables/restarts the root unit and waits up to 1800 s for
/health. The quadlet-era tree under dankserver/frank-primary/ is
archived (dankserver/.AGENTTRASH/20260926-llamacpp-cutover/ on this
box; git history everywhere else) and its planner mapping replaced by
the scripts/ trio.

Observability flips back to the llamacpp namespace: a frank-primary
Prometheus job at 192.168.0.235:7770 (cross-host LAN — the netavark
published-port quirk that forces host.containers.internal for the two
Dankclaw endpoints is same-host only), the LlmEndpointDown runbook
text, and the dashboard description for three llama.cpp endpoints.

Docs: the new runbook (frank-primary-llamacpp-qwen38-flash-next-q8.md),
RETIRED banners on the lucebox and radiance runbooks and their index
entries, the AGENTS.md fleet section rewritten for the root-unit shape,
and the homepage frank-medium card renamed to frank-primary with the
Q8_0 Flash-Next spec (docs.html #models and the modality note updated:
images on frank-primary and frank-small, audio on frank-small only).

models.yml: the dankserver provider is "llamacpp (dankserver)" serving
frank-primary, contextWindow 262144, maxTokens 65536 (compaction-gap
law: 183,501 + 65,536 <= 262,144), input [text, image].

Suite: 346 green (frank_primary_unit.bats rewritten for the root unit —
16 tests pinning the placement law, the shared-head requirement, the
explicit projector, HIP env hygiene (BIND_HOST, never bare HOST), and
the deployer's byte-count gates; the quadlet-era planner and
changed-tests mappings rewritten for the trio; the observability scrape
test asserts three llamacpp jobs again).

Rollback: the lucebox image (localhost/lucebox-rocm:gfx1201) and the
378 GiB payload stay on the host; the Qwen payload stays fetched, so a
re-swap in either direction is a redeploy, not a refetch.

serverAppConfigs-docs/LLM/index.md

@@ -1,14 +1,14 @@
 # LLM Fleet — Knowledge Base
 
-Documentation for the LLM inference fleet on the two hosts (2026-09-21):
-**vllm-radiance on Dankserver** serving frank-medium as ONE tensor-parallel
-process across both Radeon AI PRO R9700 cards (just1moremodel
-Qwen3.8-27B-Uncensored-MXFP4 + the z-lab DFlash2 drafter, bf16 KV, TP=2 over the
-R4D one-shot allreduce), and TWO endpoints on Dankclaw — stock llama.cpp
-(unsloth b11030, ROCm gfx1151; frank-large, unsloth Qwen3.8-27B UD-Q8_K_XL +
-the z-lab DFlash2 Q4_K_M drafter on the gfx1151 iGPU, port 7770) and mainline
-llama.cpp (frank-small, HauhauCS Gemma4-12B QAT Q4_K_M with MTP and vision on
-the RTX 3090, port 7771).
+Documentation for the LLM inference fleet on the two hosts (2026-09-26):
+**llama.cpp on all three endpoints** — Dankserver runs unsloth llama.cpp
+(the b11030-mix prebuilt, ROCm gfx120X) serving frank-primary
+(unsloth Qwen3.8-Flash-Next Q8_0 + the shared Q8_0 MTP head + ngram-mod +
+vision) across both Radeon AI PRO R9700s on :7770, and Dankclaw runs two
+endpoints — stock llama.cpp (unsloth b11030, ROCm gfx1151; frank-large,
+unsloth Qwen3.8-27B UD-Q8_K_XL + the z-lab DFlash2 Q4_K_M drafter on the
+gfx1151 iGPU, port 7770) and mainline llama.cpp (frank-small, HauhauCS
+Gemma4-12B QAT Q4_K_M with MTP and vision on the RTX 3090, port 7771).
 
 > 2026-08-22: the former `vllmScripts` repository is merged into the
 > serverAppConfigs repository. This knowledge base moved from the old repo's
@@ -22,11 +22,10 @@ graph LR
     subgraph Dankserver[AMD Dankserver - Ubuntu 26.04]
         A[2x Radeon AI PRO R9700
 gfx1201, 32 GiB each]
-        B2[vllm-radiance 0.9.3, TP=2
-frank-medium, port 7770]
-        C[Qwen3.8-27B MXFP4 + DFlash2 drafter
-ONE process on both cards, 262144 ctx, up to 8 seqs]
-        A --> B2 --> C
+        B2[unsloth llama.cpp b11030-mix, ROCm gfx120X
+frank-primary, port 7770]
+        C[Qwen3.8-Flash-Next Q8_0 + shared-Q8_0 MTP head
+layer split on both cards, 262144 ctx / 1 slot, ngram-mod, vision]
     end
 
     subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
@@ -53,20 +52,34 @@ frank-small, port 7771]
 
 | Server                                  | GPU                           | VRAM / Memory        | OS           |
 | --------------------------------------- | ----------------------------- | -------------------- | ------------ |
-| [[Dankserver System Specs\|Dankserver]] | 2x AMD Radeon AI PRO R9700 | 2x 32 GB VRAM, 60 GB RAM | Ubuntu 26.04 |
+| [[Dankserver System Specs\|Dankserver]] | 2x AMD Radeon AI PRO R9700 | 2x 32 GB VRAM, 246 GB RAM | Ubuntu 26.04 |
 | [[Dankclaw System Specs\|Dankclaw]]     | AMD Radeon 8060S (Strix Halo) | gfx1151 unified memory | Ubuntu 26.04 |
 
 ## Active Deployment
 
-- [[frank-medium-radiance-mxfp4]] — the ACTIVE frank-medium runbook:
-  vllm-radiance (stilldeadcode/vllm-radiance:0.9.3) serving
-  just1moremodel/Qwen3.8-27B-Uncensored-MXFP4-awq (MXFP4/quark W4A8) with the
-  z-lab DFlash2-FP8 drafter as ONE tensor-parallel process (TP=2) behind
-  :7770, now on unquantized bf16 KV (`KV_DTYPE=auto`, cut 2026-09-21 to test
-  whether the endpoint's historical fp8 KV had been degrading W4A8 quality).
-  The FP8 checkpoint (orcarouter/Qwen3.8-27B-Uncensored-FP8, the 09-20→09-21
-  shape) is the on-disk rollback. The three-arm battery that chose TP=2, the
-  auto-sized KV pool, and verified capabilities (tools, reasoning)
+- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — the ACTIVE
+  frank-primary runbook (2026-09-26, root systemd unit, port 7770):
+  unsloth llama.cpp (b11030-mix prebuilt, ROCm gfx120X, bundled runtime)
+  serving unsloth/Qwen3.8-Flash-Next-GGUF at Q8_0 across both R9700s —
+  routed experts and the 51B-param n-gram table computed in host RAM
+  (`-ot exps=CPU,ngram_embeddings=CPU`), the shared Q8_0 MTP head
+  (depth 2) chained behind ngram-mod, BF16 vision, one full 262,144-token
+  conversation, `reasoning_content`, the placement law, the cutover and
+  rollback
+- [[frank-primary-lucebox-ds4]] — RETIRED 2026-09-26 (same-day swap,
+  rollback target; active for hours): the Lucebox DS4.1 engine
+  (localhost/lucebox-rocm:gfx1201) serving
+  Lucebox/DeepSeek-V4.1-Flash-ROCMFP23 (377.2 GiB) with streamed experts —
+  the fleet's only non-llama.cpp runtime detour
+- [[frank-medium-radiance-mxfp4]] — RETIRED 2026-09-26 (replaced by
+  [[frank-primary-lucebox-ds4]], then
+  [[frank-primary-llamacpp-qwen38-flash-next-q8]]): vllm-radiance 0.9.3
+  serving just1moremodel/Qwen3.8-27B-Uncensored-MXFP4-awq (MXFP4/quark
+  W4A8) with the z-lab DFlash2-FP8 drafter as ONE tensor-parallel process
+  (TP=2) behind :7770, on unquantized bf16 KV (`KV_DTYPE=auto`, cut
+  2026-09-21). The FP8 checkpoint is the on-disk rollback. The three-arm
+  battery that chose TP=2, the auto-sized KV pool, and the verified
+  capability battery (tools, reasoning)
 - [[frank-medium-model-swap]] — how to swap the checkpoint behind frank-medium:
   the streamlining toolchain (hf-manifest.py, hf-fetch.sh,
   swap-frank-medium.sh), the quantization-aware entrypoint contract, the
@@ -181,9 +194,9 @@ frank-small, port 7771]
   on Dankclaw (superseded 2026-08-24 by the kingjones ROCmFP4 model)
 - [[kairic-edge]] — the retired Kairic Edge IU4 experiment
   (deployed and reverted 2026-08-22)
-- [[Dankserver System Specs]] — the 2x R9700 box (frank-medium)
-- [[Dankclaw System Specs]] — the Strix Halo gfx1151 box (frank-large on the
-  Kairic Edge runtime since 2026-09-21, frank-small on the RTX 3090)
+- [[Dankserver System Specs]] — the 2x R9700 box (frank-primary)
+- [[Dankclaw System Specs]] — the Strix Halo gfx1151 box (frank-large on
+  the unsloth b11030 runtime since 2026-09-21, frank-small on the RTX 3090)
 - [[frank-npu]] — RETIRED 2026-09-11: the FLM NPU sight+sound endpoint
   on Dankclaw (Gemma4 E4B vision+audio pack, XDNA2, port 7771), kept as
   the retirement record — the IOMMU/SVA err=-19 root cause and where