frank-primary: PLE ready timeout 1800s + bench matrix runbook; index/doc-link fixes
- frank-primary.env: R9V_PLE_READY_TIMEOUT=1800 (PLE registration measured 740s under page-cache churn; engine default 600s killed a prod boot 2026-09-28; launch.sh 2de0357 forwards it) - runbook: prefill/decode bench matrix section (chunk ceiling 4096, 80-slot policy max, MTP6 3.7x worse, prefix-caching evidence + recommendation), fork commit list, residency wording - index: q8 runbook ACTIVE, uncensored RETIRED (rollback); log entry incl. the 9h downtime incident
This commit is contained in:
1 parent
671f784ca4
commit
f18716563a
4 files changed
+70
-9
No files matched your search
@@ -124,13 +124,20 @@ The LLM inference fleet on the two hosts. Full index:
|
||||
|
||||
- [[deployment]] — unified deploy and update process for both servers
|
||||
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
|
||||
- [[frank-primary-r9v-radiance-qwen38-uncensored]] — the ACTIVE
|
||||
- [[frank-primary-r9v-radiance-qwen38-q8]] — the ACTIVE
|
||||
frank-primary runbook: the R9V radiance-vLLM fork (docker-pinned bundle
|
||||
`2dac17a2`, docker→podman shim) serving the abliterated
|
||||
`2dac17a2`, docker→podman shim) serving the unsloth
|
||||
Qwen3.8-Flash-Next-GGUF Q8_0 (175.30 GiB, 6 shards) + blockfp8 MTP4 +
|
||||
BF16 vision on Dankserver's both R9700s — TP=2 tiered experts (80-slot
|
||||
LRU cache), PLE pinned 54.4 GB in host RAM, CED off, 131,072 ctx single
|
||||
stream, Qwen-Sharp template, root unit with LimitMEMLOCK, the on-host
|
||||
qualified state, the cutover, and the rollback
|
||||
- [[frank-primary-r9v-radiance-qwen38-uncensored]] — RETIRED 2026-09-27
|
||||
(rollback target): the R9V radiance-vLLM fork serving the abliterated
|
||||
Dyluhn Qwen3.8-Flash-Next-Uncensored IQ4_XS (92.39 GiB) + MTP4 + F16
|
||||
vision on Dankserver's both R9700s — TP=2 tiered experts with a UVA
|
||||
pinned host copy, PLE on ssd-mmap, CED on, 196608 ctx, root unit with
|
||||
LimitMEMLOCK, the on-host 104-key tuned state, cutover and rollback
|
||||
vision — TP=2 tiered experts with a UVA pinned host copy, PLE on
|
||||
ssd-mmap, CED on, 196,608 ctx; state dir + frozen config + payload
|
||||
intact on disk
|
||||
- [[frank-primary-llamacpp-qwen38-flash-next-q8]] — RETIRED 2026-09-27
|
||||
(rollback target): unsloth llama.cpp (b11030-mix prebuilt, ROCm
|
||||
gfx120X, root unit) serving unsloth Qwen3.8-Flash-Next at Q8_0 (175.3
|
||||
|
||||
Reference in new issue
Block a user