docs: frank-large halogen runbook, AGENTS.md + indices for the swap

New runbook frank-large-halogen27b-dflash2.md; LLM + vault indices
re-pointed, ROCmFPX q6agent runbook marked RETIRED (rollback target);
AGENTS.md topology row, detail section, image-capability paragraph
(two endpoints accept images now), bench-law prose and runbook index
updated.

serverAppConfigs-docs/LLM/frank-large-halogen27b-dflash2.md

@@ -0,0 +1,119 @@
+# frank-large — halogen container, Qwen3.8-27B + DFlash2 (Dankclaw, ACTIVE 2026-10-05)
+
+frank-large is the Strix Halo iGPU endpoint on Dankclaw (`:7770`). Since
+2026-10-05 it runs the **halogen** engine — `ghcr.io/peonist-ai/halogen` at a
+pinned digest, launched by `scripts/serve-frank-large.sh` under a root
+systemd unit as a podman container — serving
+**`peonist-ai/halogen-qwen3.8-27b`** (`qwen3.8-27b-p1w4d-d2.hgn`, 35,880,329,102 B
+≈ 33.4 GiB) with the **DFlash2** drafter at **one slot x 200,700 ctx**.
+
+It replaced the ROCmFPX llama.cpp fork endpoint ([[frank-large-rocmfpx-q6agent-uncensored-mtp]]),
+which remains the rollback target with its payload on disk.
+
+## Why swap
+
+|Metric|ROCmFPX Q6_0_ROCMFPX_AGENT + MTP (retired)|halogen qwen3.8-27b + DFlash2 (active)|
+|---|---|---|
+|Prose decode|27.6–28.1 t/s measured (4.8k depth, acceptance 0.868)|31.7 t/s mean across eight text workloads (publisher card, bf16 reference hardware)|
+|Copy-echo decode|31.4 t/s|publisher reports echo inside the same 31.7 mean|
+|Context|1 x 262,144|1 x 200,700|
+|Format|GGUF (fork-private tensor types 102/103)|`.hgn` — loads in NO other engine|
+
+The swap was accepted with eyes open on two product regressions, both
+confirmed by Frank before deploy:
+
+1. **Text-only.** halogen loads the language tower only; README "honest
+   limits": *"The vision encoder is ignored; image inputs are not supported."*
+   The mmproj-era vision role moves wholly to frank-small.
+2. **Censored base.** The checkpoint is a finetune of the censored
+   `Qwen/Qwen3.8-27B` base, built to make its DFlash2 head strong. The
+   ROCmFPX AGENT file was an *Uncensored* build; refusals can return.
+
+## Shape and why
+
+`scripts/frank-large.env` carries every tunable with its evidence; the load-
+bearing numbers:
+
+- **`HALOGEN_KV_SLOTS=1` + `HALOGEN_DRAFTER=2`** — the engine offers batch OR
+  speculation, never both (FLAGS.md: "Batching and speculation are exclusive:
+  a step batches when more than one conversation is running, so the drafter
+  stays off with more than one slot"). Slots>1 silently loses DFlash2; the
+  sibling halogen engine measured 41 -> 14 t/s when slots went up. frank-large
+  was a one-conversation endpoint before (PARALLEL=1), so the contract holds.
+- **`HALOGEN_SLOT_CTX=200700`** — the per-conversation HARD ceiling: a longer
+  prompt is a 400 naming the limit, never a truncation. The harness side is
+  wired to it: `models.yml` `contextWindow: 200700`, and OMP compacts at 70%
+  = 140,490, leaving 60,210 of the slot for the reply.
+- **`HALOGEN_MAX_TOKENS_CAP=65536` + `HALOGEN_QUEUE_TIMEOUT=7200`** — coupled
+  pair (FLAGS.md table): a request at the cap must not outlive the timeout.
+  65536 > the harness's 57,344 `maxTokens` so an eager request never meets
+  the engine's 413.
+- **KV math:** 1 slot x 200,700 x 64 KiB/token (d2 KV = 2x fp8) = 12.2 GiB
+  pool, inside the ~65 GiB left after 33.4 GiB mmap'd weights + engine working
+  set + host baseline on the 121.2 GiB box. The engine sizes the pool itself
+  and **prints a boot ledger naming any clamp** — the post-deploy check reads
+  that ledger, not a formula.
+- **No server-side sampler:** an absent temperature is GREEDY. The card's
+  thinking recipe (temp 1.0 / top_p 0.95) lives in `models.yml` `extraBody`
+  — on the wire only.
+
+## Client contract deltas vs llama.cpp
+
+|Behavior|halogen|
+|---|---|
+|Prompt over slot|400 naming the limit (no truncation)|
+|`max_tokens` over cap|413, max_tokens over queue timeout|503s for the queue|
+|`response_format`|NOT supported (no constrained decoding)|
+|thinking field|`reasoning_content` (same as before)|
+|`reasoning_effort`|same Qwen3.8 template; outside {xhigh,medium,low} rejected — models.yml fold stays|
+|tools|server-side tool calls advertised — round-trip MUST be re-probed after deploy|
+|image input|ignored/error — route to frank-small|
+
+## Deploy mechanics
+
+- **Image:** `ghcr.io/peonist-ai/halogen@sha256:dc0a39a0016d6cfc58a197978febaafdf8d28403f724ded6111d98b5fb7ac0ea`
+  (published tag 0.1.4). The deployer gates the exact digest exists in podman
+  storage before dispatch. NOT the 2026-09 `halogen-flash-server` repo — that
+  was the Flash-Next w4b era, different image, retired.
+- **Payload:** `scripts/download-frank-large-halogen.sh` (fetch law: `curl -f`,
+  exact byte count, LFS/hub sha256, `--verify-only`, token never in argv) into
+  `/home/dank/models/halogen-qwen3.8-27b/`. The tokenizer bundle
+  (`frank-large.tokenizer.gguf`) must be a FLAT regular file — the deployer
+  and serve script both refuse a symlink or directory: an HF symlinked/snapshot
+  layout passes `test -f` but fails the engine's open at request time.
+- **Unit:** `scripts/frank-large.service` (root, `User=dank`, relinked into
+  `/etc/systemd/system/`), `ExecStart` = serve script, `ExecStop` = `podman
+  stop -t 120 frank-large-halogen`, script `exec podman wait` so
+  `Restart=always` is real. Engine stdout goes to
+  `/home/dank/logs/frank_large.log` (the boot ledger lives there, not in the
+  journal).
+- **Cutover:** `deploy_llm_large` in `scripts/deploy-remote.sh` sweeps the
+  legacy bare `llama-server --model /home/dank/models/kingjones-*` process and
+  the legacy `frank-large` container name by NAME (never `pkill -f
+  llama-server` — that hits frank-small), retires the old quadlet if the 2026-09
+  halogen era's unit lingers, waits port 7770 free, relinks, health-gates.
+- **Bench law:** stop+mask the unit before any GPU experiment on this box
+  (AGENTS.md); `/health` answers 503 while the 33.4 GiB payload loads — that
+  is loading, not failure.
+
+## Verification (post-deploy checklist)
+
+1. `grep -iE 'clamp|kv|pool|drafter|dflash' /home/dank/logs/frank_large.log`
+   — ledger shows the pool at the asked shape, DFlash2 active, NO clamp line.
+2. `curl -s http://192.168.0.143:7770/health` -> 200.
+3. Real completion with `reasoning_effort` + temp/top_p from the wire recipe;
+   `reasoning_content` populated; decode rate from the timings.
+4. Spec decode fires: multi-token step behavior visible in rate; compare
+   against DRAFTER=0 arm if in doubt (never against gufo — bench law).
+5. Harness round-trip: an OMP call through `llamacpp (dankclaw)/frank-large`
+   incl. a tool call (V1TOOLS).
+6. Prompt > 200,700 tokens returns the 400 naming the limit (contract test).
+
+## Rollback
+
+Revert the frank-large swap commit and redeploy `dankclaw --service frank-large`:
+the ROCmFPX payload (`/home/dank/models/kingjones-Qwen3.8-27B-ROCmFP4-STRIX-MTP/`),
+the fork build (`/home/dank/GitPackages/kingjones-ROCmFPX/build`), and its
+`scripts/build-rocmfpx.sh` pin (commit `36e9acd`, seam-tested) all remain on
+disk. The halogen payload can stay: it costs nothing while the unit points
+elsewhere.

serverAppConfigs-docs/LLM/frank-large-rocmfpx-q6agent-uncensored-mtp.md

@@ -17,7 +17,11 @@ timestamp: 2026-10-03
 
 # frank-large — ROCmFPX Uncensored Q6_0_ROCMFPX_AGENT + MTP (gfx1151)
 
-> **ACTIVE since 2026-10-03.** Cut over from
+> **RETIRED 2026-10-03 → 2026-10-05 (rollback target; payload, fork build and
+> build script all on disk).** Replaced by [[frank-large-halogen27b-dflash2]]
+> (DFlash2, publisher 31.7 t/s mean vs the 27.6–28.1 measured here). This page
+> remains the contract record for the rollback. Original banner follows.
+> ACTIVE since 2026-10-03. Cut over from
 > [[frank-large-rocmfpx-q8agent-mtp]] (ALIGNED Q8_0_ROCMFPX_AGENT, 17.0 t/s)
 > on Frank's request: the *uncensored* variant of the same protected-heads
 > family, one quant rung down. The swap turned out to be a strict upgrade on

serverAppConfigs-docs/LLM/index.md

@@ -14,11 +14,11 @@ mounted cache dir** (the image ships no `/root/.cache` at all; unmounted, every
 `torch.compile took 181.20 s`). `--max-num-seqs` must stay 3:
 SEQS 2 cannot compile this model. Rollback frank-primary-fp8-mtp-20261001),
 and Dankclaw
-runs two endpoints — **ROCmFPX llama.cpp (frank-large, port 7770:
-kingjones777/Qwen3.8-27B-Uncensored-ROCmFP4-STRIX-MTP-GGUF
-Qwen3.8-27B-Uncensored-Q6_0_ROCMFPX_AGENT, a ftype-114 file only that fork can
-read, with the repo's MTP head drafting 4 tokens at 27.6-28.1 t/s decode, ONE
-session at 262,144, f16 KV, vision via the BF16 projector)** and
+runs two endpoints — **halogen container (frank-large, port 7770:
+ghcr.io/peonist-ai/halogen @ pinned digest serving peonist-ai
+/halogen-qwen3.8-27b, a 33.4 GiB .hgn checkpoint that loads in no other
+engine, DFlash2 spec decode, ONE slot at 200,700 ctx, text-only — vision
+lives on frank-small)** and
 **llama.cpp CUDA (frank-small, port 7771: MiMo-V2.6-Distill-Qwen-9B Q6_K
 GGUF, 2 x 200,704, fully unquantized f16 KV, on the RTX 3090)**.
 
@@ -45,10 +45,10 @@ expert-precise-memory arena 7,522 slots, /root/.cache mounted]
     subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
         E2[RTX 3090 (PCIe x4 dock) +
 gfx1151 iGPU 114 GiB GTT]
-        E[ROCmFPX llama.cpp gfx1151, pinned fork build
+        E[halogen container gfx1151, digest-pinned image
 frank-large, port 7770]
-        F[Qwen3.8-27B Uncensored Q6_0_ROCMFPX_AGENT + MTP-Q4_0 head
-1 x 262144 ctx, f16 KV, draft n-max 4, mmproj vision]
+        F[halogen-qwen3.8-27b .hgn p1w4d-d2 + DFlash2 drafter
+1 x 200700 ctx, d2 KV, text-only]
         G[llama.cpp master CUDA sm_86
 frank-small, port 7771]
         H[MiMo-V2.6 Q5_K_M GGUF
@@ -71,16 +71,17 @@ frank-small, port 7771]
 
 ## Active Deployment
 
-- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — **ACTIVE since 2026-10-03**
-  (root systemd unit, port 7770): the pinned kingjones30/ROCmFPX fork serving
-  the uncensored protected-heads rung `Qwen3.8-27B-Uncensored-Q6_0_ROCMFPX_AGENT.gguf`
-  (23.15 GiB, ftype 114 = 159 type-103 + 339 GGML_TYPE_Q6_0_ROCMFPX tensors,
-  64 protected output heads) with the repo's `mtp-Qwen3.8-27B-Q4_0.gguf` head
-  drafting 4 tokens, one 262,144 window, f16 KV, the BF16 projector for
-  vision. Measured 27.6-28.1 t/s prose decode at 86.8 % draft acceptance; the
-  ngram-mod chain onto MTP was measured and REJECTED (-15 %: it disables the
-  hybrid's recurrent state rollback). Rollback: the aligned Q8 file, still on
-  disk
+- [[frank-large-halogen27b-dflash2]] — **ACTIVE since 2026-10-05**
+  (root systemd unit + podman, port 7770): the digest-pinned
+  `ghcr.io/peonist-ai/halogen` image serving `peonist-ai/halogen-qwen3.8-27b`
+  (`qwen3.8-27b-p1w4d-d2.hgn`, 33.4 GiB) with the DFlash2 drafter on ONE slot
+  of 200,700 ctx (slots>1 disables speculation — engine law). Publisher card
+  31.7 t/s mean across eight text workloads. Accepted tradeoffs: TEXT-ONLY
+  (the engine ignores the vision encoder; frank-small owns images) and the
+  CENSORED base model (the ROCmFPX AGENT file was Uncensored by construction).
+  No server-side sampler — the thinking recipe rides the wire in models.yml.
+  Rollback: revert the swap commit; the ROCmFPX payload + fork build +
+  `build-rocmfpx.sh` pin all remain on disk
 - [[frank-small-llama-mimo-q6k-2x200704]] — **ACTIVE since 2026-10-03**
   (root systemd unit, port 7771): llama.cpp master (CUDA sm_86) serving
   bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** on the RTX 3090, TWO
@@ -202,6 +203,14 @@ frank-small, port 7771]
   (bs1/bs3/bs4/bs6, 8k–700k KV) on Dankserver RTX 3090
 - [[deployment]] — deploy and update process for both servers
 - [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
+- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — **RETIRED 2026-10-03 →
+  10-05 (rollback target; payload, fork build and build script on disk)**:
+  the pinned ROCmFPX fork serving the uncensored protected-heads
+  Q6_0_ROCMFPX_AGENT rung with the repo's MTP-Q4_0 head drafting 4 tokens,
+  one 262,144 window, f16 KV; measured 27.6-28.1 t/s prose decode at 86.8 %
+  acceptance. Replaced by the halogen DFlash2 endpoint; the ngram-mod-onto-MTP
+  rejection (-15 %, recurrent-state rollback) stays a live lesson for this
+  architecture.
 - [[frank-large-rocmfpx-q8agent-mtp]] — **RETIRED 2026-10-02 → 10-03 (the
   rollback target; payload still on disk)**: the same pinned ROCmFPX fork
   serving the ALIGNED `Q8_0_ROCMFPX_AGENT` (ftype 115, 17.0 t/s, MTP

serverAppConfigs-docs/index.md

@@ -213,8 +213,16 @@ The LLM inference fleet on the two hosts. Full index:
   agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix (87.06 GiB,
   Q4_0_ROCMFP4_FAST) + own MTP draft, build-qwen38 (retired 2026-08-30;
   rollback record)
-- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — the ACTIVE frank-large
-  runbook since 2026-10-03 (root systemd unit, port 7770): the pinned
+- [[frank-large-halogen27b-dflash2]] — the ACTIVE frank-large runbook since
+  2026-10-05 (root systemd unit + podman, port 7770): the digest-pinned
+  ghcr.io/peonist-ai/halogen image serving peonist-ai/halogen-qwen3.8-27b
+  (qwen3.8-27b-p1w4d-d2.hgn, 33.4 GiB — a .hgn that loads in no other
+  engine) with the DFlash2 drafter on ONE slot of 200,700 ctx (slots>1
+  disables speculation — engine law); TEXT-ONLY and censored base, both
+  accepted tradeoffs; no server-side sampler, so the thinking recipe rides
+  the wire
+- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — RETIRED 2026-10-03 → 10-05
+  (rollback target; payload, fork build and build script on disk): the pinned
   kingjones30/ROCmFPX fork (scripts/build-rocmfpx.sh) serving kingjones777/
   Qwen3.8-27B-Uncensored-ROCmFP4-STRIX-MTP-GGUF
   **Qwen3.8-27B-Uncensored-Q6_0_ROCMFPX_AGENT** — ftype 114, 339 tensors of