frank-primary: shape F — MNBT 2048, util 0.982, CUDA-graph plan term pinned to the measured capture

The arena is budget - non-expert - KV reserve - graphs - overhead. With util
capped at 0.982 (never 1.00) the graph estimate is the only plan term this repo
can shrink: the fork charges an analytic 256 MiB + 52 MiB/graph = 0.55 GiB where
the engine's own post-capture line reports 0.31 GiB, so pricing it at
256 + 12/graph returns ~0.24 GiB to the expert arena. MNBT 1024 -> 2048 is
arena-free: the registry overhead is base + 0.22 GiB per 1024 ABOVE its nbt 4096
anchor, and the fitted 5.25 GiB was fitted AT 4096.

scripts/serve-frank-primary.sh

@@ -11,7 +11,8 @@
 # every flag here was qualified by boot probe on 2026-09-29 — see
 # frank-primary.env for the qualification record).
 #
-# Shape (2026-10-02 shape E): MAXLEN 200704 x 3 slots, fp8 KV, KV_BYTES
+# Shape (2026-10-03 shape F, on the 2026-10-02 shape E base): MAXLEN 200704 x 3
+# slots, fp8 KV, KV_BYTES
 # 3,150,000,000 PER RANK — the POOL, not the slot count, caps resident
 # conversations at ~2 full-length (measured: 398,658 tokens = 1.99x);
 # shorter requests use the spare blocks. --max-num-seqs stays 3 because SEQS=2
@@ -21,12 +22,17 @@
 # is OFF today by ENV KNOB, not by measurement: FRANK_PRIMARY_SPEC / _COMPCONFIG
 # / _GEN_CONFIG hold the whole JSON value and unset means no flag. The 2026-10-02
 # retirement of MTP compared the wrong pair — see frank-primary.env.
-# --max-num-batched-tokens 1024 (Frank's lock), MoE gather geometry
+# --max-num-batched-tokens 2048 (Frank's call 2026-10-03; arena-free because the
+# registry prices overhead flat up to its nbt 4096 anchor), MoE gather geometry
 # R4D_LRU_GATHER_CHUNKS=32 / R4D_LRU_GATHER_LANES=64 (+18.7% decode, grows
 # with depth), prefix caching, expert prefetch OFF (36% precision measured),
 # TunableOp off. Shape E adds --expert-precise-memory (fitted 5.25 GiB overhead
 # instead of the 7.60 GiB default -> expert arena 17.22 GiB / 7,522 slots, +16%)
-# and GPU_MAX_HW_QUEUES=2. The native-262144 and fp8+MTP4 shapes are retired to
+# and GPU_MAX_HW_QUEUES=2; shape F pins the plan's CUDA-graph term to the
+# measured capture cost (VLLM_CUDAGRAPH_MEM_BASE_MB / _PER_GRAPH_MB, container
+# env — the analytic default charges 0.55 GiB where capture took 0.31 GiB, so
+# the 0.24 GiB difference goes to the arena) and raises util 0.98 -> 0.982,
+# Frank's cap. The native-262144 and fp8+MTP4 shapes are retired to
 # git tag frank-primary-fp8-mtp-20261001.
 #
 # THE COMPILE CACHE IS MOUNTED, and that is a boot-cost fix, not a tuning knob:
@@ -138,6 +144,8 @@ podman run -d --name "$FRANK_PRIMARY_CONTAINER" \
   ${FRANK_PRIMARY_GPU_MAX_HW_QUEUES:+-e GPU_MAX_HW_QUEUES="$FRANK_PRIMARY_GPU_MAX_HW_QUEUES"} \
   ${FRANK_PRIMARY_GATHER_CHUNKS:+-e R4D_LRU_GATHER_CHUNKS="$FRANK_PRIMARY_GATHER_CHUNKS"} \
   ${FRANK_PRIMARY_GATHER_LANES:+-e R4D_LRU_GATHER_LANES="$FRANK_PRIMARY_GATHER_LANES"} \
+  ${FRANK_PRIMARY_CUDAGRAPH_BASE_MB:+-e VLLM_CUDAGRAPH_MEM_BASE_MB="$FRANK_PRIMARY_CUDAGRAPH_BASE_MB"} \
+  ${FRANK_PRIMARY_CUDAGRAPH_PER_GRAPH_MB:+-e VLLM_CUDAGRAPH_MEM_PER_GRAPH_MB="$FRANK_PRIMARY_CUDAGRAPH_PER_GRAPH_MB"} \
   ${CACHE_DIR:+-v "$CACHE_DIR":/root/.cache} \
   -v "$FRANK_PRIMARY_MODEL_DIR":/models:ro \
   "$FRANK_PRIMARY_IMAGE" /models \