frank-secondary: swap Swift-1.5 RCO-IQ3_XXS -> Gemma4-26B-A4B QAT Q4_K_M

Payload: HauhauCS/Gemma4-26B-A4B-QAT-Uncensored Q4_K_M (16,796,015,520 B)
+ the publisher's BF16 mmproj, /home/dank/models/Gemma4-26B-A4B/.

Shape: ONE 200,704-token slot (--parallel 1; 2x200,704 does not fit the
24 GiB card), f16 K + q8_0 V under flash attention, batch 4096 / ubatch
1024, --log-verbosity 4, MTP OFF (the gemma4-assistant file is on disk,
not loaded: its draft KV is built against the target's full window,
measured +1.9 GiB -> 23,806/319 free, no margin beside the f16-K raise).

Measured boots (nvidia-smi): q8_0 K + q8_0 V / ubatch 2048 / MTP off =
21,890 used / 2,235 free; with the MTP assistant = 23,806 / 319.

Engine facts recorded: gemma4 hybrid attention (25 sliding-window + 5
full-attention layers) so KV scales with 5 layers only, and
attention_k_eq_v is honoured by build 5fc4f3c (pool bills K-only; the
measured q8_0 pool = 2.05 GiB = the K-only figure).

Serve script gained VERBOSITY (+ --log-verbosity in the argv), the
SPEC_DRAFT_FILE drafter path, and defaults/lore retargeted to Gemma4.
deploy-remote.sh payload gates follow the env. The frank-secondary bats
seam is rewritten for the new contract (argv-based) and fixes a
pre-existing vacuity: serve_argv regenerates the test env, so
mutations made before it were silently undone - tests that mutate now
exec through run_stage. frank-secondary is the fleet compaction hub
(200,704 is the only window that fits a worst-case compaction input).

serverAppConfigs-docs/LLM/index.md

@@ -16,10 +16,9 @@ digest serving the Quat3rnion ABLITERATED Swift1.5 finetune of
 Qwen3.8-Flash-Next v2, a ~62 GiB v2 .hgn that loads in no other engine,
 MTP spec decode always-on (HALOGEN_SPEC_ADAPT=0), TWO slots at 200,192
 ctx, vision ON)** and
-**llama.cpp CUDA (frank-secondary, port 7771: ajgazin Swift-1.5-Qwen3.8-27B
-Uncensored Dynamic-MTP RCO-IQ3_XXS GGUF — 27B (the MTP head in the file
-IS drafted, draft-mtp depth 3), TWO 131,072 conversations at Frank's
-128k cap (the tightest fit in the endpoint's history — 489 MiB free),
+**llama.cpp CUDA (frank-secondary, port 7771: HauhauCS Gemma4-26B-A4B QAT
+Uncensored Q4_K_M GGUF — 26B MoE hybrid (25 sliding-window + 5 full-attention
+layers), ONE 200,704-token conversation, MTP disabled,
 q8_0 K + q8_0 V (FP8 class), vision via the publisher's own BF16
 mmproj, on the RTX 3090)**.
 
@@ -52,8 +51,8 @@ frank-large, port 7770]
 2 x 200192 ctx, MTP always-on, image input]
         G[llama.cpp master CUDA sm_86
 frank-secondary, port 7771]
-        H[Swift-1.5-27B Uncensored RCO-IQ3_XXS-mtp GGUF
-2 x 131072 ctx, q8_0 K + q8_0 V, draft-mtp depth 3, mmproj vision]
+        H[Gemma4-26B-A4B QAT Uncensored Q4_K_M GGUF
+1 x 200704 ctx, q8_0 K + q8_0 V, MTP off, mmproj vision]
         E2 --> E --> F
         E2 --> G --> H
     end
@@ -103,8 +102,17 @@ frank-secondary, port 7771]
   (`slow`/`advisor` → frank-primary) carried forward. Superseded by the
   MODEL swap: the abliterated v2 .hgn loads only in flash-server, so the
   engine moved with the model
-- [[frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688]] — **ACTIVE since
-  2026-10-05 (evening); UNCECERSED RCO-IQ3_XXS with MTP back on since
+- [[frank-secondary-llama-gemma4-q4km-200704]] — **ACTIVE since 2026-10-07**
+  (root systemd unit, port 7771): llama.cpp master (CUDA sm_86) serving
+  HauhauCS/Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced-MTP **Q4_K_M**
+  on the RTX 3090 — ONE 200,704-token conversation, q8_0 K + q8_0 V,
+  vision via the publisher's mmproj. MTP is OFF (the gemma4-assistant
+  drafter costs ~1.9 GiB: 23,806 used/319 free with it, 21,890/2,235
+  without). Supersedes the Swift-1.5 era (below).
+- [[frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688]] — **RETIRED
+  2026-10-07** (superseded by gemma4-q4km; payload on disk as rollback);
+  ACTIVE 2026-10-05 (evening) → 2026-10-07; UNCECERSED RCO-IQ3_XXS with
+  MTP back on since
   2026-10-06 evening; RENAMED from frank-small and reshaped to 2 ×
   114,688 / ubatch ladder 512 → 1024 → **2048** late 2026-10-06** (root
   systemd unit, port