docs: frank-primary q8 cutover — new runbook, uncensored retired as rollback, fleet table/index/log synced

serverAppConfigs-docs/LLM/index.md

@@ -2,9 +2,9 @@
 
 Documentation for the LLM inference fleet on the two hosts (2026-09-27):
 **Dankserver runs R9V radiance-vLLM on frank-primary** (the drwolfen fork
-serving the abliterated Dyluhn Qwen3.8-Flash-Next-Uncensored IQ4_XS + MTP4
-across both Radeon AI PRO R9700s on :7770, docker-pinned runtime driven
-through a docker→podman shim), and Dankclaw runs two llama.cpp endpoints —
+serving the unsloth Qwen3.8-Flash-Next Q8_0 + MTP4 across both Radeon AI
+PRO R9700s on :7770, docker-pinned runtime driven through a docker→podman
+shim, the Qwen-Sharp template, 131072 ctx), and Dankclaw runs two llama.cpp endpoints —
 stock llama.cpp (unsloth b11030, ROCm gfx1151; frank-large, unsloth
 Qwen3.8-27B UD-Q8_K_XL + the z-lab DFlash2 Q4_K_M drafter on the gfx1151
 iGPU, port 7770) and mainline llama.cpp (frank-small, HauhauCS Gemma4-12B
@@ -25,8 +25,8 @@ gfx1201, 32 GiB each]
         B2[R9V radiance-vLLM fork, docker-pinned
 via docker-podman shim
 frank-primary, port 7770]
-        C[Qwen3.8-Flash-Next-Uncensored IQ4_XS
-TP=2 tiered experts, MTP4, CED, 196608 ctx, vision]
+        C[Qwen3.8-Flash-Next Q8_0
+TP=2 tiered experts, MTP4, sharp template, 131072 ctx, vision]
     end
 
     subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
@@ -58,16 +58,27 @@ frank-small, port 7771]
 
 ## Active Deployment
 
-- [[frank-primary-r9v-radiance-qwen38-uncensored]] — the ACTIVE
-  frank-primary runbook (2026-09-27, root systemd unit, port 7770): the
-  R9V radiance-vLLM fork (drwolfen/radiance-vllm-qwen4exp, docker-pinned
+- [[frank-primary-r9v-radiance-qwen38-q8]] — the ACTIVE frank-primary
+  runbook (2026-09-27, root systemd unit, port 7770): the R9V
+  radiance-vLLM fork (drwolfen/radiance-vllm-qwen4exp, docker-pinned
   image bundle `2dac17a2`, driven through a docker→podman shim) serving
+  the unsloth Qwen3.8-Flash-Next-GGUF Q8_0 (175.30 GiB, 6 shards) +
+  blockfp8 MTP4 (depth 4) + vision on BOTH R9700s — TP=2 tiered experts
+  (80-slot LRU cache), PLE n-gram PINNED in host RAM (54.4 GB), CED off,
+  131072 ctx, the Qwen-Sharp v22.4.0 template via the launcher's
+  `R9V_CHAT_TEMPLATE_FILE` passthrough (fork `30d4a32`), the quantized
+  inject-shard dev-overlay adapter (fork `363d606`), reasoning channel
+  `reasoning`, parser `qwen3_coder`. The tuned shape lives in the
+  on-host q8xl setup state. Rollback:
+  [[frank-primary-r9v-radiance-qwen38-uncensored]]
+- [[frank-primary-r9v-radiance-qwen38-uncensored]] — RETIRED 2026-09-27
+  (same-day swap to the Q8_0 payload; rollback target, state + payload
+  intact on disk): the R9V radiance-vLLM fork serving
   Dyluhn/Qwen3.8-Flash-Next-Uncensored-R9V-IQ4_XS (92.39 GiB, 3 shards) +
   blockfp8 MTP4 (depth 4) + F16 vision on BOTH R9700s — TP=2 tiered
   experts (UVA pinned host copy, 62 hot + 160-slot LRU on rank 0, 428
-  static on rank 1), PLE n-gram on ssd-mmap, CED on, 196608 ctx, reasoning
-  channel `reasoning`, parser `qwen3_coder`. Root unit + LimitMEMLOCK;
-  the tuned 104-key shape lives in the on-host setup state. Rollback:
+  static on rank 1), PLE n-gram on ssd-mmap, CED on, 196608 ctx. Cut over
+  from llama.cpp the same day; rollback target
   [[frank-primary-llamacpp-qwen38-flash-next-q8]]
 - [[frank-primary-llamacpp-qwen38-flash-next-q8]] — RETIRED 2026-09-27
   (rollback target; the llama.cpp b11030 endpoint of 2026-09-26):