frank-primary: pin the expert host region to 120 GiB (--expert-offload-mem)
The host region was the ONE arena-plan term still autofitting per boot: with no cap the planner binds it to MemAvailable AT BOOT minus PLE/process/api/ margin terms (boot 2026-10-05: 237.97 GiB -> 159.39 GiB usable; the same host reads 75.4 GiB available while running). Demand is 105.48 GiB (52.74/rank x 2 ranks, 23,040 swap-target experts); a boot where co-tenant RAM squeezed the bound near that silently pins next-hottest experts VRAM-only (pinned_extra warning, smaller swap region, no flag change). 120 GiB = measured demand + 14% headroom on 246.1 GiB total. Semantics verified in the shipped image: cap binds as the bound, exceedance only warns. The GPU-side arena is unchanged (deterministic arithmetic over the same constants): verify after boot that host reads '--expert-offload-mem' and slots stay 7,762. Seam: red first (wiring + value), then green; full suite 368+1 green.
This commit is contained in:
1 parent
9a144f779e
commit
c4603b130c
4 files changed
+40
No files matched your search
@@ -188,6 +188,14 @@ DOWNLOAD="$REPO_ROOT/scripts/download-frank-primary.sh"
|
||||
grep -q -- '-e VLLM_CUDAGRAPH_MEM_PER_GRAPH_MB="$FRANK_PRIMARY_CUDAGRAPH_PER_GRAPH_MB"' "$SERVE"
|
||||
grep -q '^FRANK_PRIMARY_CUDAGRAPH_BASE_MB=0$' "$ENV_FILE"
|
||||
grep -q '^FRANK_PRIMARY_CUDAGRAPH_PER_GRAPH_MB=12$' "$ENV_FILE"
|
||||
# The host region is the ONE plan term that autofits per-boot: with no cap
|
||||
# the bound is MemAvailable at that moment (boot 2026-10-05: 237.97 GiB ->
|
||||
# 159.39 GiB usable, while the running host later reads 75.4 GiB available).
|
||||
# An explicit --expert-offload-mem cap makes the plan deterministic whatever
|
||||
# the co-tenant RAM state is at boot; 120 GiB covers the measured 105.48
|
||||
# GiB of swappable experts (52.74/rank x 2) with 14% headroom.
|
||||
grep -q -- '${FRANK_PRIMARY_EXPERT_OFFLOAD_MEM:+--expert-offload-mem "$FRANK_PRIMARY_EXPERT_OFFLOAD_MEM"}' "$SERVE"
|
||||
grep -q '^FRANK_PRIMARY_EXPERT_OFFLOAD_MEM=120$' "$ENV_FILE"
|
||||
}
|
||||
|
||||
@test "tools and reasoning are wired — the client contract is served" {
|
||||
|
||||
Reference in new issue
Block a user