docs(core): snapcompact accuracy audit — measured shape table + pricing law #82

Merged
dank merged 1 commits from docs/81-snapcompact-accuracy into main 2026-10-27 18:39:36 -07:00
Owner

Closes #81. Docs half of the snapcompact accuracy audit; the config half is already live (machine-live tier, heartbeat commits): compaction.thresholdPercent 95 → 85, imageCountBudget: 16 on the frank-archon row.

Measured (live probe on frank-archon, 212,916-char archive, 8 planted facts):

Leg Frames Billed Recall
text baseline — 63,066 8/8
auto = 8on22-bw 14 33,533 8/8
8on16-bw 11 24,364 6/8
11on16-bw 14 33,533 6/8

Kept unchanged (verified optimal): shape: auto, systemPrompt: none, toolResults: false, deterministic-first methodOrder.

New page omp-docs/core/snapcompact.md carries the shape-resolution table, the sizing law, the catalog-only frame-pricing law (radiance ~2,400 tok/frame vs the harness's blind 5,024 floor — no user-row key can fix it), and the 85 % trigger law. Index + log entry included.

Checks: kb-lint 0 violations; bats tests/ 137 ok / 0 fail (run thrice incl. the pre-commit hook); fresh omp -p parses the edited config/models.yml. No path in this PR is touched by the live-checkout config edits, so the merge stays clean.


cwd: /home/blank/.omp/wt/wt-20261027-181709-7c8a99d · session: 01a18015-1638-7446-b40e-b8d2016680d1

Closes #81. Docs half of the snapcompact accuracy audit; the config half is already live (machine-live tier, heartbeat commits): `compaction.thresholdPercent` 95 → 85, `imageCountBudget: 16` on the frank-archon row. **Measured (live probe on frank-archon, 212,916-char archive, 8 planted facts):** | Leg | Frames | Billed | Recall | |---|---|---|---| | text baseline | — | 63,066 | 8/8 | | auto = `8on22-bw` | 14 | 33,533 | **8/8** | | `8on16-bw` | 11 | 24,364 | 6/8 | | `11on16-bw` | 14 | 33,533 | 6/8 | Kept unchanged (verified optimal): `shape: auto`, `systemPrompt: none`, `toolResults: false`, deterministic-first `methodOrder`. New page `omp-docs/core/snapcompact.md` carries the shape-resolution table, the sizing law, the catalog-only frame-pricing law (radiance ~2,400 tok/frame vs the harness's blind 5,024 floor — no user-row key can fix it), and the 85 % trigger law. Index + log entry included. Checks: `kb-lint` 0 violations; `bats tests/` 137 ok / 0 fail (run thrice incl. the pre-commit hook); fresh `omp -p` parses the edited config/models.yml. No path in this PR is touched by the live-checkout config edits, so the merge stays clean. --- cwd: /home/blank/.omp/wt/wt-20261027-181709-7c8a99d · session: 01a18015-1638-7446-b40e-b8d2016680d1
dank added 1 commit 2026-10-27 18:37:39 -07:00
Live probe against frank-archon (212,916-char archive, 8 planted facts):
auto shape 8on22-bw reads back 8/8 recall at 47% of raw-text billed
tokens; both denser grids drop characters. Lands the docs for the paired
live-config changes (thresholdPercent 95->85, imageCountBudget 16) and
records the catalog-only frame-pricing law (radiance ~2,400 tok/frame vs
the harness's blind 5,024 floor).

Refs #81
dank merged commit 702847cefd into main 2026-10-27 18:39:36 -07:00
Sign in to join this conversation.
No Reviewers
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: dank/command-center#82