frank-primary: shape G measured — arena 17.77 GiB / 7,762 slots, KV 401,408 tokens / 2.00x
Record the live numbers and the UTIL 1.0 verdict (unbootable: worker init demands free > budget; ValueError on both ranks before a single weight loads). Driver used 30.97 of 31.86 GiB; the 0.89 GiB/card margin held through a live 4,096-token generation at ~38-39 tok/s.
This commit is contained in:
@@ -1,5 +1,42 @@
|
||||
# Bundle Change Log
|
||||
|
||||
## 2026-10-03
|
||||
- **frank-primary: shape F then shape G — MNBT 2048, the CUDA-graph plan term
|
||||
pinned to the measured capture, KV forced to 400,700 tokens, and UTIL 1.0
|
||||
proven UNBOOTABLE.** Frank asked what the batch was with GPUs showing open
|
||||
space; the audit found the arena is `budget - non-expert - KV reserve -
|
||||
graphs - overhead` where the only deploy-reachable terms are the budget and
|
||||
the graph estimate (registry KV price 9,190 B/token and the 5.25 GiB
|
||||
overhead are image constants; the ~3.5 GiB of driver-free VRAM was
|
||||
estimator slack, not allocatable).
|
||||
- Shape F (c682c63): MNBT 1024 -> 2048 (arena-free — the registry prices
|
||||
overhead flat up to its nbt 4096 anchor and the fitted 5.25 was fitted AT
|
||||
4096), util 0.98 -> 0.982, graph term 0.55 -> 0.32 GiB (256 base +
|
||||
12/graph vs the fork's 256 + 52/graph). Measured: arena 17.52 GiB /
|
||||
7,653 slots, budget 31.29.
|
||||
- Shape G v1 (0a4ff30) tried util 1.0: **both workers refused init before a
|
||||
single weight loaded** — `ValueError: Free memory on device cuda:N
|
||||
(31.29/31.86 GiB ...)`, NRestarts=2 crash loop, zero payload progress.
|
||||
The CLI field is `Field(gt=0, le=1)`, but the worker demands free >
|
||||
budget, so budget == total is a trap, not a knife-edge. Frank: ".982 is
|
||||
the law, never 1.00" — now with a second proof.
|
||||
- Shape G v2 (c67a2ae, deployed green incl. e2e 33/33): util back to
|
||||
0.982, graph base to 0 (the shape F boot reported a NEGATIVE -0.06 GiB
|
||||
capture delta, so the 256 MiB base was fiction; 0 + 12 MiB/graph still
|
||||
prices a future 18-graph spec-decode shape at 0.21 GiB), KV_BYTES
|
||||
3.15e9 -> 3.1665e9 = Frank's 400,700-token ask.
|
||||
- MEASURED live: arena **17.77 GiB / 7,762 slots** (+240 over shape E),
|
||||
KV **401,408 tokens / 2.00x concurrency** — the first shape holding two
|
||||
full-length conversations with real spare; capture measured 0.31/0.10
|
||||
GiB against the 0.07 charge (under-charged, boots and holds); driver
|
||||
used 30.97 of 31.86 GiB -> **0.89 GiB real free per card**, held through
|
||||
a live 4,096-token generation (~38-39 tok/s single-request wall-incl.,
|
||||
+13% vs the 33.99 shape-E baseline; single sample, not a bench).
|
||||
- Verification seam rewritten to assert the shape by its OUTPUTS (util at
|
||||
the 0.982 law, graph charge below the analytic default and per-graph
|
||||
positive, KV pool >= 400,700 tokens at the measured 7,892 B/token).
|
||||
Runbook: `serverAppConfigs-docs/LLM/dankserver-qwen38-fp8-expert-offload-tuning.md`.
|
||||
|
||||
## 2026-10-01
|
||||
- **frank-primary rolled BACK to Qwen3.8-Flash-Next-Uncensored-FP8 + MTP4;
|
||||
GLM/DFlash2 declared failed and purged.** The DFlash2 drafter booted and
|
||||
|
||||
Reference in New Issue
Block a user