docs(frank-dragoon): production boot ledger, worklog, retired-era ctx fix
Deploy verification for fcd7630 (22:20): healthy in ~12 s, e2e 33/33, and the
boot ledger settles the shape — 62.9 GiB weights locked (0.8 vision) + 7.2 GiB
KV in ONE 262,144-position pool (6,656 MiB, two slots) + 5.7 GiB working =
75.8 GiB in all, n-gram 47.68 GiB read from disk, prompt cache ON (12 entries),
MTP depth-2, no clamp line. Live probes: 27*59 -> 1593, tool call, red PNG ->
Red. The two KV figures are reconciled (engine preflight FORMULA 7.4 GiB
includes block scratch + per-slot O(1) state; the RESERVATION is 7.2).
Also corrects two stale claims: the retired swift15 rows named 200,192 ctx
(raised to 262,144 on 2026-10-07 inside that same era), and the OpenWebUI
frank-dragoon row's description is now re-keyed in the live DB (backup
webui.db.bak-20261017b).
This commit is contained in:
@@ -185,3 +185,37 @@ mandatory); unknown sampling params are a 400; the prompt cache is on by
|
||||
default, so a warm 100k follow-up costs seconds. See
|
||||
[[frank-dragoon-flash-server-v2-swift15]] for the engine-flag detail that
|
||||
carries verbatim, and [[deployment]] for the deploy/health gate.
|
||||
|
||||
## Production boot — the deploy ledger (2026-10-17 22:20, `fcd7630`)
|
||||
|
||||
`./scripts/deploy.sh dankclaw --service frank-dragoon`: healthy after ~12 s,
|
||||
deploy marker `fcd7630`, e2e gate 33/33. The trial drop-in went to
|
||||
`~/.AGENTTRASH/20261017-v2abl-trial/` FIRST, so this boot is governed by the
|
||||
repo env — `systemctl show -p DropInPaths` is empty.
|
||||
|
||||
Ledger lines that settle the shape (engine stdout, not the journal):
|
||||
|
||||
|Line|Figure|
|
||||
|---|---|
|
||||
|preflight|`MemAvailable now 105.4 GiB` against the engine's own estimate of 62.1 weights + 6.0 working + 7.4 KV + 1.3 prompt cache|
|
||||
|weights|`62.9 GiB of weights locked in RAM (0.8 of them the vision tower's)`|
|
||||
|KV pool|`reserving the KV pool, 262144 positions (about 7.2 GiB)`; `the KV is ONE pool of 262144 positions (6656.0 MiB) carved into per-request regions`; slots `1 -> 2 POOLED, 111.0 MiB each of O(1) state`|
|
||||
|working memory|5.7 GiB at `HALOGEN_MAX_TOK 8192`|
|
||||
|total|`75.8 GiB in all` — ~25 GiB of the 121.2 GiB box left for co-tenants|
|
||||
|n-gram|`47.68 GiB from /models/qwen38-flash-next-ngram.hgn`, `checkpoint: mapped 51.2 GB, NOT pinned (Pin::None)` — disk-backed exactly as designed|
|
||||
|prompt cache|ON, resume-anywhere, 12 entries, chunk 32768, `HALOGEN_CACHE_INPLACE=1` (the KV rows are never copied)|
|
||||
|spec decode|`MTP depth-2 selectable (drafter 1, speculates while alone)`|
|
||||
|clamps|none — the requested pool is the delivered pool|
|
||||
|
||||
Read the two KV figures together: the engine's preflight FORMULA bills 7.4 GiB
|
||||
(~28 KiB/position **including** block scratch and ~115 MiB/slot of O(1) state)
|
||||
while the RESERVATION is 7.2 GiB / 6,656 MiB. Quote the reservation for the
|
||||
RAM ledger and the formula when comparing pool sizes.
|
||||
|
||||
Live probes on the deployed endpoint: `27*59` → `1593` with a warm thinking
|
||||
channel, tool call `{"city": "Seattle"}`, 512 px solid-red PNG → **Red** (320
|
||||
prompt tokens — the image reached the model), greedy 512-token decode 46.9 t/s
|
||||
on the FIRST request after boot, i.e. the warmup artifact; the trial's settled
|
||||
figure is 50.0. OpenWebUI's `frank-dragoon` row description re-keyed to the
|
||||
native payload (backup `webui.db.bak-20261017b`; no container restart forced —
|
||||
forcing it logs every family session out for one cosmetic string).
|
||||
|
||||
@@ -98,7 +98,7 @@ frank-zealot, port 7771]
|
||||
stay on disk
|
||||
- [[frank-dragoon-flash-server-v2-swift15]] — **RETIRED 2026-10-06 → 10-17
|
||||
(rollback target: payload + fetch script on disk)**: the Swift1.5-finetuned
|
||||
v2 `.hgn` (compacted r2, 66,687,678,464 B) at TWO slots × 200,192 ctx over
|
||||
v2 `.hgn` (compacted r2, 66,687,678,464 B) at TWO slots at ctx 262,144 over
|
||||
a 524,288-position pool; owns the 400-zone law (the harness chars/4
|
||||
under-count against the engine ceiling), the MTP-always-on law, and the
|
||||
sampler / prompt-cache / vision contract the native era carries verbatim
|
||||
|
||||
Reference in New Issue
Block a user