frank-primary: record the measured shape-E and compile-cache numbers

Live after the 1ac4d48 deploy: 'expert_precise_memory': True, runtime overhead
5.25 GiB, expert cache space 17.22 GiB / 7522 slots, swap region 13.7 GiB /
5986 slots, GPU KV cache 398,658 tokens / 1.99x, pool 3,150,000,000, MNBT 1024
-- the probe's projection is now production.

Compile cache proven on consecutive boots of that shape: cold 'Compiling a
graph for compile range (1, 1024) takes 179.24 s' / 'torch.compile took
188.26 s'; warm 'Directly load the compiled graph(s) ... from the cache, took
2.143 s' / 'torch.compile took 3.97 s in total' / 'init engine ... took 41.13 s
(compilation: 3.98 s)'. Host dir 1.4 GB / 4,707 files. Time to /health stays
payload-bound (490 s warm), so the claim is ~184 s of inductor/AOT build per
restart, not a proportional boot cut.

Tests: 367/367.

scripts/frank-primary.env

@@ -127,6 +127,16 @@ FRANK_PRIMARY_GPU_MAX_HW_QUEUES=2
 # compiled function to /root/.cache/vllm/torch_compile_cache/…'. Mounting a
 # host dir at /root/.cache persists the vLLM AOT/torch_compile tree AND the
 # comgr HIP-kernel JIT cache, and hides nothing (the image has no such dir).
+# PROVEN LIVE 2026-10-02, two boots of this exact shape:
+#   cold  `Compiling a graph for compile range (1, 1024) takes 179.24 s`
+#         `torch.compile took 188.26 s in total`
+#   warm  `Directly load the compiled graph(s) for compile range (1, 1024)
+#          from the cache, took 2.143 s`
+#         `torch.compile took 3.97 s in total`
+#         `init engine (profile, create kv cache, warmup model) took 41.13 s
+#          (compilation: 3.98 s)`
+# (Total time to /health is dominated by the 172.8 GiB payload load, not the
+# compile — the saving is the ~184 s of inductor/AOT build.)
 # Safe to grow/prune: entries are keyed by version + config hash, so a stale
 # entry is a miss, never a wrong answer.
 FRANK_PRIMARY_CACHE_DIR=/home/dank/.cache/frank-primary

scripts/serve-frank-primary.sh

@@ -32,7 +32,11 @@
 # container's ephemeral layer, and `podman rm -f` deletes them — so every
 # deploy/restart/reboot re-pays `torch.compile took 181.20 s in total` (173.19 s
 # of it one graph). Mounting FRANK_PRIMARY_CACHE_DIR at /root/.cache makes all
-# later boots load the compiled artifact instead, and hides nothing.
+# later boots load the compiled artifact instead, and hides nothing. PROVEN
+# LIVE 2026-10-02 on consecutive boots of this shape: cold `torch.compile took
+# 188.26 s`, warm `Directly load the compiled graph(s) for compile range
+# (1, 1024) from the cache, took 2.143 s` / `torch.compile took 3.97 s in
+# total` / `init engine … took 41.13 s (compilation: 3.98 s)`.
 #
 # The root unit (scripts/frank-primary.service, User=dank,
 # LimitMEMLOCK=infinity) grants the pin budget for the tiered-expert host