Snapcompact accuracy audit: threshold 85, frank-archon image-count budget, measured shape table #81

Closed
opened 2026-10-27 18:37:26 -07:00 by dank · 0 comments
Owner

Audit of snapcompact settings against the accuracy question: "Am I using the most accurate snapcompaction settings?"

Moving parts (one config edit each, plus the docs page):

  1. agent/config.yml: compaction.thresholdPercent 95 → 85 — restores the max_tokens gap-math written into agent/models.yml; 95 routes compaction through the overflow-refuse path.
  2. agent/models.yml frank-archon row: imageCountBudget: 16 — custom providers inherit the unknown-provider floor of 5 images/request and silently halve the snapcompact archive.
  3. Docs: omp-docs/core/snapcompact.md (measured recall/billing table from a live probe, the catalog-only frame-pricing law, the 85 % trigger law) + index + log entry.

Verdict on the knobs themselves: snapcompact.shape: auto, systemPrompt: none, toolResults: false, deterministic-first methodOrder — all verified accuracy-optimal by probe (auto shape 8/8 recall at 47 % of raw-text billed tokens; denser grids drop characters).


cwd: /home/blank/.omp/wt/wt-20261027-181709-7c8a99d · session: 01a18015-1638-7446-b40e-b8d2016680d1

Audit of snapcompact settings against the accuracy question: "Am I using the most accurate snapcompaction settings?" Moving parts (one config edit each, plus the docs page): 1. `agent/config.yml`: `compaction.thresholdPercent` 95 → 85 — restores the max_tokens gap-math written into `agent/models.yml`; 95 routes compaction through the overflow-refuse path. 2. `agent/models.yml` frank-archon row: `imageCountBudget: 16` — custom providers inherit the unknown-provider floor of 5 images/request and silently halve the snapcompact archive. 3. Docs: `omp-docs/core/snapcompact.md` (measured recall/billing table from a live probe, the catalog-only frame-pricing law, the 85 % trigger law) + index + log entry. Verdict on the knobs themselves: `snapcompact.shape: auto`, `systemPrompt: none`, `toolResults: false`, deterministic-first `methodOrder` — all verified accuracy-optimal by probe (auto shape 8/8 recall at 47 % of raw-text billed tokens; denser grids drop characters). --- cwd: /home/blank/.omp/wt/wt-20261027-181709-7c8a99d · session: 01a18015-1638-7446-b40e-b8d2016680d1
dank closed this issue 2026-10-27 18:39:36 -07:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: dank/command-center#81