governance: bench is removed from the model-swap procedure

Model changes verify by driving the live service — boot ledger,
per-request timings, one real request per harness role. No bench window
is ever scheduled for a swap. The stop-and-mask policy stays for
deliberate standalone bench windows (it is host protection, not a swap
step). Codified in AGENTS.md (policy lead + summary row), Model Swap and
Rollback (No bench step law, §8 close-out source, Related rescope).
This commit is contained in:
Frank committed 2026-10-15 03:07:46 -07:00
1 parent a9d45e7012
commit 39b8396794
3 files changed
+41 -4

No files matched your search

+19
View File
@@ -1745,3 +1745,22 @@ every restart since the cutover.
[[frank-archon-radiance-swift15-w4dn8]], and the LLM index entry corrected
(the w4dn8 entry said STAGED, the fp8-native one said ACTIVE).
## 2026-10-15 — governance: bench removed from the model-change procedure
- Frank's call: a model swap never carries a bench window. Codified as law:
- `AGENTS.md` Benchmarking Policy opens with "Benchmarking is NOT part of
the model-swap procedure"; swap verification is the live service (boot
ledger, `timings`/`Server-Timing`, one real request per harness role).
The stop-and-mask rule stays for DELIBERATE bench windows (flag A/Bs,
shape sweeps) — it is host protection (2026-09-16 hard-down precedent),
not a swap step. Summary-table row updated to match.
- [[Model Swap and Rollback]]: "No bench step (law, 2026-10-15)" up top;
§8 close-out numbers must be measured on the live service; the Related
link to [[LLM Bench Windows and Measurement]] rescoped to
out-of-procedure windows only.
- Untouched on purpose: the `FRANK_*_ENV_FILE` hook (staged/out-of-procedure
arms), the Fleet Ops Playbook bench-window mechanics (deliberate windows
still need the procedure), `deployment.md` (already says bench work is a
SEPARATE procedure). Managed skill `llamacpp-endpoint-model-swap` verifies
on the live engine — it never had a bench step.