frank-primary: R9V runbook + docs cutover

New ACTIVE runbook (setup/doctor PASS=34/FAIL=0, UVA transport verified
in serving workers, wire-verified alias/reasoning/metrics), index +
vault entries flipped: llama.cpp b11030 endpoint RETIRED 2026-09-27 to
rollback target. Topology diagram updated.
This commit is contained in:
Frank
2026-09-27 04:35:05 -07:00
parent 7562e41ba4
commit ca6ba6d0e9
3 changed files with 161 additions and 16 deletions
+9 -2
View File
@@ -124,8 +124,15 @@ The LLM inference fleet on the two hosts. Full index:
- [[deployment]] — unified deploy and update process for both servers
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — the ACTIVE
frank-primary runbook: unsloth llama.cpp (b11030-mix prebuilt, ROCm
- [[frank-primary-r9v-radiance-qwen38-uncensored]] — the ACTIVE
frank-primary runbook: the R9V radiance-vLLM fork (docker-pinned bundle
`2dac17a2`, docker→podman shim) serving the abliterated
Dyluhn Qwen3.8-Flash-Next-Uncensored IQ4_XS (92.39 GiB) + MTP4 + F16
vision on Dankserver's both R9700s — TP=2 tiered experts with a UVA
pinned host copy, PLE on ssd-mmap, CED on, 196608 ctx, root unit with
LimitMEMLOCK, the on-host 104-key tuned state, cutover and rollback
- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — RETIRED 2026-09-27
(rollback target): unsloth llama.cpp (b11030-mix prebuilt, ROCm
gfx120X, root unit) serving unsloth Qwen3.8-Flash-Next at Q8_0 (175.3
GiB) on Dankserver's both R9700s — the shared Q8_0 MTP head chained
behind ngram-mod, BF16 vision, the experts and the 51B n-gram table