frank-primary cutover: tcclaviger RDNA4 stack, 600k ctx / 3 sessions / q8-q8 KV

Replace the R9V radiance fork with the tcclaviger RDNA4 vLLM stack (the
digest-pinned image the 2026-09-29 tuning campaign measured), serving
orcarouter/Qwen3.8-Flash-Next-Uncensored-FP8 (131 shards, 172.8 GiB,
already on disk) with MTP4 spec decode.

Qualified by boot probe on 2026-09-29:
- MAXLEN=200000 x SEQS=3 (600k total) at --kv-cache-dtype fp8 (q8/q8 KV):
  'GPU KV cache size: 729,545 tokens; Maximum concurrency for 200,000
  tokens per request: 3.65x' at KV_BYTES 7.2 GiB PER RANK.
- KV_BYTES is per-rank: global 16G and 9G both OOM (worker tried to
  allocate the full size; ~7.5 GiB/rank is the ceiling with the arena).
- prefetch OFF by law (telemetry: 36% precision, ~50% wasted traffic);
  TunableOp off (corrupts numerics).
- decode at this shape: 42.94/34.55/36.09 tok/s; arena 6,032 slots.

Trio: frank-primary.env (all FRANK_PRIMARY_* keys), serve-frank-primary.sh
(direct podman run; entrypoint execs vllm serve; waits on the container),
frank-primary.service (root unit, same ExecStop law, new container name
frank-primary-qwen). Deployer gates rewritten (image digest + shard count
+ weight-map index). download-frank-primary.sh is now inventory/verify
(repo is GATED — 401 anonymous, masked LFS hashes; payload already on
disk). Seam rewritten for the new contract. Pre-cutover tag:
frank-primary-r9v-q8-20260929.

scripts/frank-primary.env

@@ -1,52 +1,61 @@
-# frank-primary.env — R9V radiance-vLLM production overrides (dankserver :7770).
+# frank-primary.env — tcclaviger RDNA4 vLLM production config (dankserver :7770).
 #
-# The full tuned engine shape (tiered-expert placement, CPU offload budgets
-# per rank, MTP4 drafter, TP=2, qwen3_coder tool parser, 131072 model len,
-# 80-slot tiered expert cache, PLE pinned residency 54.4 GB) lives on-host
-# in the R9V setup state — /home/dank/r9v-state/q8xl/setup.json — written by
-# the q8 profile's setup run (ready: true; doctor PASS, artifacts
-# sha256-verified at fetch time). serve-frank-primary.sh layers that state
-# first and THIS FILE second, so the keys below win. Never copy tuned values
-# from the state into this file — the state is the single source of truth
-# for engine shape.
-R9V_HOME=/home/dank/GitPackages/radiance-vllm-qwen4exp
-R9V_STATE_FILE=/home/dank/r9v-state/q8xl/setup.json
-# Fleet identity: LAN bind, the single frank-primary port, the harness's
-# model id, our own container name (the launcher default r9v-qwen38-flash-next
-# is the scratch identity).
-R9V_HOST_BIND=0.0.0.0
-R9V_HOST_PORT=7770
-R9V_SERVED_MODEL_NAME=frank-primary
-R9V_CONTAINER_NAME=frank-primary-r9v
-R9V_EXPECTED_GPU_BDFS=0000:03:00.0,0000:07:00.0
-# PLE registration (54.4 GB mmap -> HIP) can exceed the engine's 600 s
-# VLLM_PLE_OFFLOAD_READY_TIMEOUT default under page-cache churn (measured
-# 740 s on 2026-09-28, right after a bench teardown; a production boot
-# failed on it the same morning). launch.sh 2de0357 forwards this to the
-# engine; 1800 s covers the slowest observed registration with margin.
-R9V_PLE_READY_TIMEOUT=1800
-# The Q8_0 payload quantizes BOTH fused hyper-connection shards (the IQ4_XS
-# package ships inject as F32), so the shard-uniformity check rejects the
-# fused projection at load. This dev-overlay adapter dequantizes a quantized
-# inject shard in-stream (fork commit 363d606): opt-in mount, uncensored
-# payloads pass through unchanged.
-R9V_DEV_QWEN4_EXP_ADAPTER_PY=/home/dank/GitPackages/radiance-vllm-qwen4exp/runtimes/dev-overrides/qwen4_exp.py
-# The runtime overlay's env.always injects R9V_FULL_MUTABLE_CACHE=1 — the
-# qualified 160-slot uncensored IQ4_XS cache geometry — which the q8
-# profile's 80-slot tiered cache fails with a baseline mismatch. This flips
-# that injection off for this payload (launch.sh passes it after the overlay
-# envs; docker last-wins).
-R9V_FULL_MUTABLE_CACHE=0
-# The Qwen-Sharp template (the frank-large fleet law): folds reasoning
-# efforts (high/xhigh/max -> xhigh, minimal/low -> low) and defaults
-# preserve_thinking true. --chat-template wins over the tokenizer dir's
-# metadata/chat_template.jinja; request-level kwargs still win per request.
-# Braces in values get the same single-quote law as parentheses (source
-# parses assignment values).
-R9V_CHAT_TEMPLATE_FILE=/home/dank/serverAppConfigs/scripts/qwen-sharp-v22.4.0.jinja
-R9V_CHAT_TEMPLATE_KWARGS='{"preserve_thinking":true}'
-# Prefix caching (bench matrix E8, 2026-09-28): qualified on the q8 profile
-# at 131072, zero VRAM cost (reuses freed KV blocks), cold path unchanged.
-# Reuse-heavy traffic (harness retries/resends) hits from the third round:
-# 32k TTFT 44.2 s -> 3.6 s, 131k 439 s -> 6.9 s. Reversible: flip to 0.
-R9V_ENABLE_PREFIX_CACHING=1
+# 2026-09-29 cutover from the R9V radiance-vLLM fork (its launcher/shim/state
+# machinery is retired; /home/dank/r9v-state/{q8xl,uncensored} stay on disk as
+# the rollback target, and git tag frank-primary-r9v-q8-20260929 is the last
+# pre-cutover commit). The engine is the tcclaviger RDNA4 vLLM fork — the same
+# digest-pinned image the 2026-09-29 tuning campaign measured — serving
+# orcarouter/Qwen3.8-Flash-Next-Uncensored-FP8 (~172.8 GiB, 131 shards) with
+# the MTP4 drafter on the two R9700s.
+#
+# Every number here was QUALIFIED by boot probe on 2026-09-29 (not inherited):
+#   * MAXLEN 200000 x SEQS 3 (600k total) at KV q8/q8 fits with headroom:
+#     the engine measured "GPU KV cache size: 729,545 tokens; Maximum
+#     concurrency for 200,000 tokens per request: 3.65x" at KV_BYTES 7.2 GiB
+#     per rank. KV_BYTES is PER RANK — sizing it to the global requirement
+#     OOMs the worker (measured twice: 16 GiB and 9 GiB both die with ~7.5 GiB
+#     free; 7.2 GiB boots).
+#   * --kv-cache-dtype fp8 is the fleet's q8/q8 KV ask (e4m3 for BOTH K and V
+#     — the stock flag quantizes them together, which is exactly what was
+#     requested here). Accepted by the attention path; qualified with a
+#     completion probe.
+#   * PREFETCH IS ABSENT BY LAW: expert-cache telemetry measured the
+#     prefetcher at 36% precision (36,720 slabs prefetched, 13,369 served) —
+#     roughly half the gather traffic was waste; prefetch off is the tuned
+#     incumbent and the +40-51% decode came from deleting the flag. Never
+#     re-add --expert-prefetch without a fresh A/B.
+#   * TunableOp stays OFF: CLAV_TUNABLEOP_SWEEP silently skips under expert
+#     offload unless CLAV_TUNABLEOP_WITH_OFFLOAD=1, and forcing it corrupts
+#     numerics (repetition loops, early halts, invalid measurements).
+# Decode at the tuned shape: 40.57/37.44/37.57 tok/s (166/1087/4064 ctx) at
+# the 32k window; 42.94/34.55/36.09 at this 200k shape (arena 6,032 slots).
+#
+# HIP reads bare env vars TEMP, HOST, GPU_MAX_HEAP_SIZE — every key here is
+# prefixed FRANK_PRIMARY_ so none can leak.
+
+# --- runtime ----------------------------------------------------------------
+# Digest-pinned: the floating :latest tag moved once already. Local alias
+# qwen-fp8-runtime:tuned-20260929 (image ID 3322dbbbc96d) points at the same
+# bytes in rootless storage.
+FRANK_PRIMARY_IMAGE=docker.io/tcclaviger/vllm@sha256:da4029666668b90a0386c1ed23ea370c79916ad4e1a6ad1dd9db098b9fa069ea
+
+# --- payload ----------------------------------------------------------------
+FRANK_PRIMARY_MODEL_DIR=/home/dank/models/Qwen3.8-Flash-Next-Uncensored-FP8
+FRANK_PRIMARY_MODEL_SHARDS=131
+
+# --- identity ---------------------------------------------------------------
+# The harness models.yml id stays frank-primary (provider 192.168.0.235:7770).
+FRANK_PRIMARY_CONTAINER=frank-primary-qwen
+FRANK_PRIMARY_SERVED_NAME=frank-primary
+FRANK_PRIMARY_PUBLISH=7770:7770
+# Containers removed before every start: the retired R9V identity and the ad
+# hoc experiment identity (both hold the GPUs / name registrations).
+FRANK_PRIMARY_LEGACY_CONTAINERS=frank-primary-r9v qwen-fp8
+
+# --- qualified engine shape ---------------------------------------------------
+FRANK_PRIMARY_MAXLEN=200000
+FRANK_PRIMARY_SEQS=3
+FRANK_PRIMARY_KV_BYTES=7730934784
+FRANK_PRIMARY_KV_DTYPE=fp8
+FRANK_PRIMARY_SPEC=4
+FRANK_PRIMARY_UTIL=0.98