feat(frank-archon): raise the pinned host pool; the campaign inherits the step
frank-archon.env: HOST_POOL_MIB 49,152 -> 66,560 a rank (tp x 65 GiB against the 246 GiB the box has), and the TTM pair 162,000/204,800 -> 197,000/224,000 — the floor the bats ledger formula computes at the new pool. The pool is the KV lever under the budget resolver: every MiB pinned in host RAM lowers the expert floor on the card one-for-one and the cache takes it. scripts/run-qwen38-bf16.sh: the campaign's private FRANK_QWEN38_MNBT (1,024) is gone — MNBT now comes from FRANK_ARCHON_MAX_BATCHED_TOKENS, production's 2,048 and the widest step the quantised expert file tiers stream. That 1,024 was PR #80's answer to a starved cache; the pool is the fix, a narrow step was the symptom's disguise, and a per-mode literal measures a shape nothing serves. tests: frank_archon_unit greps the new pool value; qwen38_reference's SHAPE fixture carries it, and the two MNBT-override tests become the inheritance assertion (every mode's argv quotes the value the env file owns) plus the calib assertions. vault: the shape block moves to the new numbers and the Eras table gains the row for the era this replaces. The 2026-10-20 boot-ledger line stays as the old era's record until the new boot's ledger replaces it.
This commit is contained in:
1 parent
a3ff55efd8
commit
255796b3dc
5 files changed
+52
-51
No files matched your search
@@ -74,7 +74,12 @@ FRANK_ARCHON_PLACEMENT=expert_tiered
|
||||
# residency -- ~3.2 GiB a card of experts now lives in host RAM and is read over the
|
||||
# x8 link when the router picks it. The ledger's coverage line is the referee, not
|
||||
# this file: if vram_kv comes back under 700,000 tokens, raise this 1024 and redeploy.
|
||||
FRANK_ARCHON_HOST_POOL_MIB=49152
|
||||
# 2026-10-29: 49,152 -> 66,560 (tp x 65 GiB, inside the 246 GiB the box has). The
|
||||
# campaign rig's bf16 container at the shared step reported "kv cache 269.99 MiB a
|
||||
# card: 7436 tokens", so 682 of the 1,294 calibration documents were refused at that
|
||||
# pool; the pool, not the step, is what widens it (scripts/run-qwen38-bf16.sh). The
|
||||
# new cache line belongs to the next boot ledger, not to this comment.
|
||||
FRANK_ARCHON_HOST_POOL_MIB=66560
|
||||
# VRAM left unclaimed per card (publisher default 96 MiB); the engine's settle
|
||||
# floor is built from it.
|
||||
FRANK_ARCHON_GPU_HEADROOM_MIB=96
|
||||
@@ -137,9 +142,10 @@ FRANK_ARCHON_NGRAM_PLACEMENT=ram
|
||||
# itself before refusing by name, so recovery is a boot, not a visit.
|
||||
# Floor = 2 x HOST_POOL + 48,824 (static weights + arena) + PREFIX_CACHE + MNBT + the
|
||||
# auto checkpoint store (MAX_SEQS x 10 slots of 111.98 MiB), per the bats ledger test;
|
||||
# at the 49,152 pool with 4 slots that computes to 161,848 MiB.
|
||||
FRANK_ARCHON_TTM_MIN_MIB=162000
|
||||
FRANK_ARCHON_TTM_TARGET_MIB=204800
|
||||
# at the 66,560 pool with 4 slots that computes to 196,664 MiB (161,848 at the old
|
||||
# 49,152 pool).
|
||||
FRANK_ARCHON_TTM_MIN_MIB=197000
|
||||
FRANK_ARCHON_TTM_TARGET_MIB=224000
|
||||
# Escape hatch for experiments. Unset -> no extra argv; the serve script expands
|
||||
# this unquoted on purpose, so keep multi-flag values as one string.
|
||||
FRANK_ARCHON_EXTRA_ARGS=
|
||||
|
||||
Reference in new issue
Block a user