docs: frank-secondary at 2x114688/ubatch 1024 — runbook renamed + rewritten, fleet docs updated

- runbook git mv ...-mtp-131072.md -> ...-mtp-114688.md; new Measured
  section (22,374 used / 1,751 MiB free, decode 58.2/66.9 t/s, confounded
  vs 2x131072 noted), rollback ladder, trail entry
- AGENTS.md: topology row, ACTIVE section, contextWindow 114688, runbook
  index; mmproj name corrected to the publisher's mmproj-BF16.gguf
- LLM/index.md, index.md, mimo runbook link, log.md entry + path fix

AGENTS.md

@@ -27,7 +27,7 @@ merge absorbed the former `vllmScripts` repo, history preserved).
 |--------|---------|---------|-------|------|
 | Dankserver | `frank-primary` | **radiance** (StillDeadcode v1.0.7 line; image `stilldeadcode/radiance@sha256:4c3f484564…` digest-pinned INDEX digest, 287 MiB, `libr4d` gfx1201 kernels, plain `podman run`, root systemd unit) | `Qwen/Qwen3.8-Flash-Next-FP8` official (172.8 GB, 131 shards, sha256-verified) converted **no-recipe** to `qwen4exp-fp8-native.rad` (177,109 MiB measured = 173.0 GiB) — **native modelopt block-FP8, no requantisation** — on **BOTH R9700s TP=2** (`--tp-wire wht6`), experts in a **40 GiB/rank pinned host pool** + VRAM cache (`--placement expert_tiered`, `--expert-vs-cache-ratio 0.82` = the 99 %-hit point), **PLE 47.7 GiB pinned to host RAM** (`--ngram-placement ram`; root unit + `LimitMEMLOCK=infinity`), **fp8 KV 7.32 KiB/token**, **MTP spec decode depth 3**, *…
 | Dankclaw | `frank-large` | **halogen-flash-server 0.16.2** (`ghcr.io/peonist-ai/halogen-flash-server@sha256:0c61bf84…`, digest-pinned, plain `podman run` via `scripts/serve-frank-large.sh`, root systemd unit) | Quat3rnion/halogen-swift1.5-qwen3.8-flash-next-v2-abliterated **`qwen38-flash-next-v2-swift15-abliterated.hgn`** (66,687,678,464 B = compacted r2 of the card's 89,775,868,032 B original, ~62 GiB resident; the v2 `.hgn` format loads in NO other engine), **+ REQUIRED `qwen38-flash-next-ngram.hgn`** (51,200,246,144 B, peonist @5cc17cea — read beside the checkpoint) **+ vision tower** (897,916,416 B, @e053f488 — **vision ON**, `image_url` parts only, ≥256 px probes), **MTP spec decode ALWAYS-ON (`HALOGEN_SPEC_ADAPT=0` — the adaptive default disables the head per request and HALVES decode)**, MTP head INSIDE the checkpoint (`HALOGEN_MTP_HEAD` unset; no sidecar fetched), **2 slots × 200,192 ctx** (KV pool 400,384 positions ≈ 10.7 GiB at ~28 KiB/position; the 27B slots>1-disables-drafting law does NOT carry over — batching and speculation coexist, the card's quickstart ships 2 with the head), **server-side sampler 1.0/0.95/20** (card recipe; models.yml extraBody matches), coupled cap/timeout 65536/7200, prompt cache ON by default (warm 100k turn ≈ 2 s vs ≈ 88 s cold) | 7770 |
-| Dankclaw | `frank-secondary` | llama.cpp master (0.5.0-dev, commit `5fc4f3c`), CUDA sm_86 build (root systemd unit, relinked) | ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF **RCO-IQ3_XXS -mtp** (27B dense qwen3_5 hybrid, 10,442,827,392 B; a per-tensor allocation mix of stock types; the MTP head in the file **drafted** — **spec ON** (draft-mtp depth 3) since 2026-10-06 evening, ngram skipped on the recurrent-rollback law) + the publisher's own **BF16 mmproj** for **vision**, on the RTX 3090, **2 × 131,072** (Frank's 128k cap each; the tightest fit in the endpoint's history — **489 MiB measured free**, the 2-3 GiB floor knowingly violated) with **q8_0 K + q8_0 V (FP8 class, 34 KiB/token)** under flash attention, batch 4096 / ubatch 512; **63.3 t/s recipe decode** (MTP acceptance 49.8 %; 48.0 no-spec). Supersedes the same-morning IQ3_S-mtp payloads: the two-slot no-spec shape and the one-slot MTP shape (both 2026-10-06; payload on disk).|7771|
+| Dankclaw | `frank-secondary` | llama.cpp master (0.5.0-dev, commit `5fc4f3c`), CUDA sm_86 build (root systemd unit, relinked) | ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF **RCO-IQ3_XXS -mtp** (27B dense qwen3_5 hybrid, 10,442,827,392 B; a per-tensor allocation mix of stock types; the MTP head in the file **drafted** — **spec ON** (draft-mtp depth 3) since 2026-10-06 evening, ngram skipped on the recurrent-rollback law) + the publisher's own **BF16 mmproj** for **vision**, on the RTX 3090, **2 × 114,688** (Frank's 112k cap each since the 2026-10-06 late reshape, cut from 131,072 to fund **ubatch 1024** — **1,751 MiB measured free**) with **q8_0 K + q8_0 V (FP8 class, 34 KiB/token)** under flash attention, batch 4096 / ubatch 1024; **58.2 t/s recipe decode / 66.9 (temp 0)** (MTP acceptance 42.8–54.4 %). Renamed from `frank-small` 2026-10-06 (87721ab). Supersedes the same-morning IQ3_S-mtp payloads: the two-slot no-spec shape and the one-slot MTP shape (both 2026-10-06; payload on disk).|7771|
 
 Retired endpoints (`frank-npu`, and every prior runtime) are in
 the [runbook index](#runbook-index). The full swap history lives in
@@ -308,11 +308,11 @@ image]`) — `frank-large` returned to vision with the flash-server v2 swap
 27-layer Qwen-VL tower — patching, pad-token expansion and 3-part rotary
 are the engine core; `--mm-max-patches` available),
 and `frank-secondary` through
-`mmproj-MiMo-V2.6-Distill-Qwen-9B-f16.gguf` passed as `--mmproj` — the MiMo
+the publisher's own `mmproj-BF16.gguf` passed as `--mmproj` — the Swift
 GGUF itself carries no vision tensors. `frank-secondary`'s `contextWindow` is
-**200704** (resliced from 180224 on 2026-10-03), the per-slot window, not the
-model's native 262144: the harness must compact before llama.cpp answers a
-longer prompt with a 400. Note also
+**114688** (cut from 131072 on 2026-10-06 late to fund ubatch 1024), the
+per-slot window, not the model's native 262144: the harness must compact
+before llama.cpp answers a longer prompt with a 400. Note also
 that
 the reasoning channel differs by runtime: llama.cpp AND SGLang (qwen3
 parser, live-verified) emit `reasoning_content`, vLLM emits `reasoning` —
@@ -423,8 +423,10 @@ the publisher's own `mmproj-BF16.gguf`** (931,145,888 B, sha256
 `19acd7fc…`), both `/home/dank/models/Swift15-UncIQ3XXS/`, on port 7771.
 Cutover 2026-10-05 (evening) on Frank's explicit contract: **128k
 context cap, KV at FP8, vision on, as many 128k contexts as fit**;
-reshaped twice on 2026-10-06 — morning to two 131,072 slots no-spec,
-evening to this UNCERSED RCO-IQ3_XXS payload with MTP back on. The
+reshaped three times on 2026-10-06 — morning to two 131,072 slots
+no-spec, evening to this UNCERSED RCO-IQ3_XXS payload with MTP back
+on, late the RENAME to **frank-secondary** (87721ab) at two 114,688
+slots with ubatch 1024. The
 same-day payloads it supersedes: the LIVE MiMo-V2.6 Q6_K shape and the
 Ornith-1.5-9B Q8_0 swap that was committed (77decb5..380aafa) but never
 deployed (blocked at the docs gate; the docs debt is what this section
@@ -438,31 +440,36 @@ at q8_0**. The DeltaNet state is a fixed per-slot buffer (~150 MiB/slot at
 48 linear layers × 48 value heads). Header facts were read from the Hub
 file by HTTP range + struct parse before anything was downloaded.
 
-**The shape (2026-10-06, Frank's tight-fit order, MTP back on in the
-evening):** `--ctx-size 262144 --parallel 2` = **TWO 131,072-token
-conversations** (Frank's 128k cap each; `n_ctx_slot = CTX_SIZE /
-PARALLEL`), `--flash-attn on` pinned, **q8_0 K + q8_0 V** (llama.cpp's
+**The shape (2026-10-06 late; Frank's tight-fit order, MTP back on in
+the evening, per-slot cut + ubatch raised late):** `--ctx-size 229376
+--parallel 2` = **TWO 114,688-token conversations** (Frank's 112k cap
+each; `n_ctx_slot = CTX_SIZE / PARALLEL`; cut from 131,072 to fund
+ubatch 1024), `--flash-attn on` pinned, **q8_0 K + q8_0 V** (llama.cpp's
 FP8 class — no true fp8 KV dtype exists; 8.5 effective bits; supersedes
 the same-day f16/f16 rule written for the Ornith 9B fit), all layers on
-the GPU, `--mmproj` for vision, batch 4096 / ubatch 512. **Speculative
+the GPU, `--mmproj` for vision, batch 4096 / ubatch 1024. **Speculative
 decoding is ON** (draft-mtp, depth 3): the -mtp file's head is drafted
 against the main model's own weights; ngram-mod skipped on purpose — on
 a qwen35 hybrid ngram disables recurrent-state rollback, so a rejected
 draft corrupts the DeltaNet state.
 
-**Measured at the two-slot MTP boot (2026-10-06 evening): 23,636 used /
-489 MiB free** (`nvidia-smi` free field) — the tightest fit in the
-endpoint's history, under the old 2-3 GiB floor BY ORDER; a 512×512
-solid-red image still answers `Red` afterwards (489 MiB free after the
-probe), so the fit carries the vision transients. The MTP draft ctx
-costs **~2.4 GiB measured** (23,636 − 22,728 + 1,561) — ~6× the ~0.4 GiB
-the one-slot era assumed, because the drafter's KV is built against the
-target's full 262,144 context (the draft window), not the 3-token
-proposal depth; the lighter RCO-IQ3_XXS quant (−1.56 GiB vs IQ3_S-mtp)
-funds it. **Decode: 63.3 tok/s (recipe temp 1.0) / 72.9 (temp 0)** with
-MTP acceptance 49.8–62.4 % (48.0 no-spec — the drafter earned its
-2.4 GiB). `reasoning_effort` probe unchanged: `xhigh` 200, `high` → 500
-Jinja raise (the models.yml fold stays mandatory).
+**Measured at the late boot (2026-10-06, 2 × 114,688 / ubatch 1024):
+22,374 used / 1,751 MiB free** (`nvidia-smi` free field) — the per-slot
+cut freed ~1.05 GiB of KV, which paid for the ubatch-1024 buffers and
+netted ~1.25 GiB back over the evening's tightest-ever fit (23,636 used
+/ 489 MiB free at 2 × 131,072 / ubatch 512, under the old 2-3 GiB floor
+BY ORDER; a 512×512 solid-red image still answered `Red` there, so the
+fit carries the vision transients). The MTP draft ctx costs **~2.4 GiB
+measured** (23,636 − 22,728 + 1,561 at the 262,144 draft window) — ~6×
+the ~0.4 GiB the one-slot era assumed, because the drafter's KV is
+built against the target's FULL context, not the 3-token proposal
+depth; the lighter RCO-IQ3_XXS quant (−1.56 GiB vs IQ3_S-mtp) funds it.
+**Decode at the late boot: 58.2 tok/s (recipe temp 1.0) / 66.9 (temp
+0)**, acceptance 42.8–54.4 % (the 2 × 131,072 boot read 63.3 / 72.9 at
+49.8–62.4 % — acceptance is text-dependent and the prompts differ: the
+comparison is confounded, not a shape verdict). `reasoning_effort`
+probe unchanged: `xhigh` 200, `high` → 500 Jinja raise (the models.yml
+fold stays mandatory).
 
 **Vision with the publisher's own projector**: ajgazin's repo SHIPS
 `mmproj-BF16.gguf` in the same repo (the IQ3_S era's unsloth mmproj was
@@ -485,7 +492,7 @@ payload is the UNCECERSED Swift 1.5 (23/100 refusals vs Swift 1.5's
 98/100, KL 0.0884).
 
 Runbook:
-`serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-131072.md`.
+`serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688.md`.
 Rollback: `/home/dank/models/Swift15-IQ3S/` (the IQ3_S-mtp payload live
 until the 2026-10-06 evening swap — revert da36fa3 for the two-slot
 no-spec shape) or `/home/dank/models/MiMo-Q6K/` (revert to the
@@ -1014,7 +1021,7 @@ Active:
 | Service | Runbook |
 |---------|---------|
 | frank-large (flash-server 0.16.2, abliterated Swift1.5 v2 .hgn + MTP always-on, 2×200,192, vision ON, Dankclaw) | `serverAppConfigs-docs/LLM/frank-large-flash-server-v2-swift15.md` |
-| frank-secondary (llama.cpp CUDA, Swift-1.5-27B Uncensored RCO IQ3_XXS-mtp, 2×131,072 draft-mtp q8_0 KV, Dankclaw) | `serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-131072.md` |
+| frank-secondary (llama.cpp CUDA, Swift-1.5-27B Uncensored RCO IQ3_XXS-mtp, 2×114,688 draft-mtp q8_0 KV, Dankclaw) | `serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688.md` |
 | frank-primary (radiance StillDeadcode, Qwen3.8-Flash-Next-FP8 native, 2×R9700 TP=2, Dankserver) | `serverAppConfigs-docs/LLM/frank-primary-radiance-qwen38-native-fp8.md` |
 | Dankclaw kernel posture (`amd_iommu=off`) | `serverAppConfigs-docs/LLM/dankclaw-iommu-translation-off.md` |
 | Deployment flow + incidents | `serverAppConfigs-docs/LLM/deployment.md` |
@@ -1028,7 +1035,7 @@ Retired (rollback targets and history):
 | tcclaviger vLLM fork Qwen3.8-Flash-Next-Uncensored FP8, TP=2, shape G (`frank-primary`) | Dankserver | 2026-09-29 → 10-05 (rollback target — tag `frank-primary-vllm-shapeG-20261003`; trio + env lore in the tag, image in rootless storage) | `dankserver-qwen38-fp8-expert-offload-tuning.md` |
 | FreeToken PR #587 ROCm, Qwen3.8-Flash-Next-Uncensored-FP8, ONE R9700 (`frank-primary`) | Dankserver | 2026-10-05 → 10-05 (rollback target — tag `frank-primary-freetoken-pr587-20261005`; trio + Dockerfile in the tag, image `localhost/frank-primary-freetoken:pr587-77a7201` and orcarouter payload on disk) | `frank-primary-freetoken-pr587.md` |
 | llama.cpp master MiMo-V2.6-Distill-Qwen-9B Q6_K 2×200,704 f16 KV (`frank-secondary`) | Dankclaw | 2026-10-03 → 10-05 (rollback target — payload on disk; owns the ubatch-2048 A/B; the Ornith swap of 10-05 was committed but never deployed, so this was the LIVE payload Swift replaced) | `frank-secondary-llama-mimo-q6k-2x200704.md` |
-| llama.cpp Ornith-1.5-9B Q8_0, ONE 262,144 f16 KV (`frank-secondary`) | Dankclaw | 2026-10-05 (committed 77decb5→380aafa, never deployed — superseded by Swift the same evening; payload on disk) | trail in `frank-secondary-llama-swift15-unc-iq3xxs-mtp-131072.md` |
+| llama.cpp Ornith-1.5-9B Q8_0, ONE 262,144 f16 KV (`frank-secondary`) | Dankclaw | 2026-10-05 (committed 77decb5→380aafa, never deployed — superseded by Swift the same evening; payload on disk) | trail in `frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688.md` |
 | ROCmFPX llama.cpp fork Qwen3.8-27B Q8_0_ROCMFPX_AGENT + MTP (`frank-large`) | Dankclaw | 2026-10-02 → 10-03 (rollback target, payload on disk) | `frank-large-rocmfpx-q8agent-mtp.md` |
 | gufo v0.1.1 Qwen3.8-27B UD-Q8_K_XL/UD-Q4_K_XL + DFlash2 (`frank-large`) | Dankclaw | 2026-09-28 → 10-01, again 10-01 → 10-02 (payloads removed from disk 2026-10-03; rollback = re-download) | `frank-large-gufo-qwen38-27b.md` |
 | vLLM TheRock MiMo-V2.6-Distill-Qwen-9B BF16 + cross-model MTP (`frank-large`) | Dankclaw | 2026-10-01 (same-day rollback to gufo) | `frank-large-vllm-mimo-v26-bf16.md` |