docs(frank-zealot): PTQ1_0 was ordered, measured and approved — not an unfinished arm
Frank's 02:36 instruction (archive 01a14c93) ordered the 27B PTQ1_0 arm at 2 x 200,704 with the Q8 mmproj and batch/ubatch 3072/1536; it served production 03:14:39-03:38:57 (pid 191358, journal type ptq1_0: 402 tensors). Recovered its numbers from that process's own print_timing lines: ~48 t/s single-stream decode, 25-27 t/s per stream at two streams, prefill 1,295 t/s at 30,637 -> 943 at 97,856 -> 801 at 141,365. It bought the promised 1,201 MiB and lost 37% of decode against the PQ2_0 record, so the publisher's Ampere warning generalizes to GA102; Frank scratched the 27B plan at 03:33 for the 9B. Every 'unfinished experiment' claim is re-keyed, and the AGENTS.md law gains the durable lesson: a bench verdict that never reaches the repo is indistinguishable from a rogue arm.
This commit is contained in:
@@ -1183,14 +1183,22 @@ linked runbooks.
|
||||
gate sees it.** The sanctioned bench-window method — a transient
|
||||
`Environment=FRANK_<SVC>_ENV_FILE=/tmp/<arm>.env` drop-in, the arm env
|
||||
`source`ing the repo env and then overriding it — outlives the bench unless
|
||||
it is retired. On 2026-10-18 a stale `frank-zealot.service.d/ptq1.conf` from
|
||||
an unfinished experiment made the cutover deploy boot a **different model at
|
||||
a different shape** (3 slots of 133,888, not 3 × 262,144) while `/health`
|
||||
answered 200, `/v1/models` echoed the alias (a flag, not a fact) and the
|
||||
Playwright gate passed 33/33. After deploying any recently-benched LLM
|
||||
service: `systemctl show <svc> -p DropInPaths` (must be empty), then
|
||||
`tr '\0' ' ' </proc/$(pidof llama-server)/cmdline`, then the boot ledger —
|
||||
and retire drop-ins to `~/.AGENTTRASH/<date>-<topic>/` + `daemon-reload`.
|
||||
it is retired. On 2026-10-18 a leftover `frank-zealot.service.d/ptq1.conf` —
|
||||
the arm Frank had ordered at 02:36 and measured from 03:14 — made the cutover
|
||||
deploy boot a **different model at a different shape** (3 slots of 133,888,
|
||||
not 3 × 262,144) while `/health` answered 200, `/v1/models` echoed the alias
|
||||
(a flag, not a fact) and the Playwright gate passed 33/33. After deploying any
|
||||
recently-benched LLM service: `systemctl show <svc> -p DropInPaths` (must be
|
||||
empty), then `tr '\0' ' ' </proc/$(pidof llama-server)/cmdline`, then the boot
|
||||
ledger — and retire drop-ins to `~/.AGENTTRASH/<date>-<topic>/` +
|
||||
`daemon-reload`.
|
||||
- **A bench verdict that never reaches the repo is indistinguishable from a
|
||||
rogue arm.** Same window: PTQ1_0 served production for 24 minutes with real
|
||||
numbers (~48 t/s decode, 801 t/s prefill at 141k), but the figures lived only
|
||||
in `/tmp` env files and journald, so the next agent on the host read the
|
||||
surviving drop-in as an unfinished experiment and reported a hijack. Write the
|
||||
measurement into the runbook and the arm script's header in the session that
|
||||
takes it — `/tmp` and the journal are not records.
|
||||
|
||||
**Ops**
|
||||
|
||||
|
||||
Reference in New Issue
Block a user