frank-primary: R9V runbook + docs cutover
New ACTIVE runbook (setup/doctor PASS=34/FAIL=0, UVA transport verified in serving workers, wire-verified alias/reasoning/metrics), index + vault entries flipped: llama.cpp b11030 endpoint RETIRED 2026-09-27 to rollback target. Topology diagram updated.
This commit is contained in:
@@ -124,8 +124,15 @@ The LLM inference fleet on the two hosts. Full index:
|
||||
|
||||
- [[deployment]] — unified deploy and update process for both servers
|
||||
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
|
||||
- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — the ACTIVE
|
||||
frank-primary runbook: unsloth llama.cpp (b11030-mix prebuilt, ROCm
|
||||
- [[frank-primary-r9v-radiance-qwen38-uncensored]] — the ACTIVE
|
||||
frank-primary runbook: the R9V radiance-vLLM fork (docker-pinned bundle
|
||||
`2dac17a2`, docker→podman shim) serving the abliterated
|
||||
Dyluhn Qwen3.8-Flash-Next-Uncensored IQ4_XS (92.39 GiB) + MTP4 + F16
|
||||
vision on Dankserver's both R9700s — TP=2 tiered experts with a UVA
|
||||
pinned host copy, PLE on ssd-mmap, CED on, 196608 ctx, root unit with
|
||||
LimitMEMLOCK, the on-host 104-key tuned state, cutover and rollback
|
||||
- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — RETIRED 2026-09-27
|
||||
(rollback target): unsloth llama.cpp (b11030-mix prebuilt, ROCm
|
||||
gfx120X, root unit) serving unsloth Qwen3.8-Flash-Next at Q8_0 (175.3
|
||||
GiB) on Dankserver's both R9700s — the shared Q8_0 MTP head chained
|
||||
behind ngram-mod, BF16 vision, the experts and the 51B n-gram table
|
||||
|
||||
Reference in New Issue
Block a user