From c5ac0725f7345cba302c0881dd1b2a24bce8935a Mon Sep 17 00:00:00 2001 From: Frank Date: Thu, 15 Oct 2026 05:44:09 -0700 Subject: [PATCH] =?UTF-8?q?docs(frank-archon):=20iq4r=20first-boot=20ledge?= =?UTF-8?q?r=20=E2=80=94=20pin=201.0.13=20loads=20w4nl,=20geometry=20verba?= =?UTF-8?q?tim?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit kv_attn 26.00 KiB fp8 pages at 607,740 tokens (identical to the w4dn8 boot), slab 17,610/17,658 slots per rank (above w4dn8's 17,548 — ten bf16-protected experts per layer pack more of the 4-bit table), sampler 9 rows, MTP 2/step, KV lending 4.22 GiB, prefix tier recovered 900,176 blocks across the payload swap. Vision probe green (reasoning read the solid-red PNG; empty content at 64 tokens = the thinking-budget law). e2e gate RED on three dankclaw specs: Marreta was down since the 01:41 dankclaw reboot (marreta-browser dependency-failed at boot beside gluetun, not re-armed); pair restarted manually, redeploy rerunning the gate. --- .../LLM/frank-archon-radiance-qwen38-iq4r.md | 40 +++++++++++++++---- 1 file changed, 32 insertions(+), 8 deletions(-) diff --git a/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md b/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md index 98342ce..6ea3cea 100644 --- a/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md +++ b/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md @@ -88,14 +88,38 @@ the same file. 3. Deploy: `scripts/deploy.sh dankserver --service frank-archon` — launched detached (the swap restarts the very endpoint the operator session runs on; the harness timeout catches the session on return). -4. **Boot ledger (fill after first boot)**: `weights/kv` per-rank budgets, - `kv_attn` page size, slab slot count, `backs N sequences` line, sampler - rows, unclaimed MiB. The load of this file on pin 1.0.13 is the gate: a - refusal naming the w4nl codebook means the pin predates the encoding — - the documented repair is the pin bump to the card's era, which the - 2026-10-06 1.2.0 A/B (decode 29.21 vs 30.08 t/s, acceptance 0.7123 vs - 0.7549) makes a paid decision. -5. **Post-boot measurements (pending)**: decode ladder (99.0 t/s single +4. **Boot ledger (2026-10-15, first boot, pin 1.0.13 — the w4nl codebook + loaded, no pin bump)**: `kv_attn` fp8 page **26.00 KiB** at **607,740 + tokens** (151,935 blocks = 3.77 GiB) — byte-identical to the w4dn8 boot, + the sizing law carries; `kv_qsa_bkey` 3.25 KiB at the same token count; + `kv_gdn_state` 54 MiB × 6 slots, `kv_gdn_conv` 1.76 MiB × 3, + `kv_qsa_tail` 19.5 KiB × 6; pool **5.00 GiB**, prefix checkpoints 8 × + 56 MiB; the sizing line reads `kv cache 5.00 GiB … backs 3 sequences all + at 200000 tokens at once, which is the worst case`; samplers print **9 + rows** per rank (3 × (1+2), inside the wht6 25-row bound); + `speculation: 'mtp' drafts 2 token(s) a step in 2 serial pass(es)` + + prompt-lookup fallback; slab **17,610 (rank0) / 17,658 (rank1) slots** + (64 shadow) — above the w4dn8 record of 17,548 (ten bf16-protected + experts per layer replace twenty-four, so more of the 4-bit table + resides), pinned pool 7,532/7,484 slots; KV lending **4.22 GiB** + (3,571/3,568 mover slots); arenas 896.02/988.17 MiB charged before the + pair split; prefix cache RECOVERED 900,176 blocks + 126 checkpoint slots + from the 64 GiB disk tier (same arch + tokenizer as w4dn8 — the tier + survived the payload swap); froggeric template 28,234 B; vision encoder + live (≤ 4,194,304 px, 16,384 patches/pass). Health gate passed in ~100 s + (radiance binds the port after the full load). +5. **Vision probe (2026-10-15)**: 300 px solid-red PNG via `image_url` — + reasoning stream: "a solid fill of a deep, saturated red hue". Content + came back EMPTY at `max_tokens 64`: the thinking budget consumed all 64 + (`reasoning_tokens: 64`, finish `length`) — fleet law, probe thinking + models with ≥ a few hundred tokens. +6. **e2e gate**: deploy exited DEPLOY INCOMPLETE — 30/33 Playwright green, + 3 red (`12-crawl`, `13-sso` search SSO, `16-marreta`) on DANKCLAW + surfaces (vhosts intermittently returned `ERR_CONNECTION_RESET` from the + workstation); frank-archon's own health gate passed. The swap touched no + dankclaw runtime file (only homepage services.json text). Census of the + Caddy/auth stack pending; see `log.md`. +7. **Post-boot measurements (pending)**: decode ladder (99.0 t/s single @ 43.5k, 93.3 @ 197k, 3-way 113.9/43.3/10.9 = 18.4 t/s aggregate — these are the **w4dn8** numbers, the record to beat, not this file's), slab-limited prefill (22208/3,397 → 25600/3,584 t/s A-cold 43.5k), draft