governance: bench is removed from the model-swap procedure
Model changes verify by driving the live service — boot ledger, per-request timings, one real request per harness role. No bench window is ever scheduled for a swap. The stop-and-mask policy stays for deliberate standalone bench windows (it is host protection, not a swap step). Codified in AGENTS.md (policy lead + summary row), Model Swap and Rollback (No bench step law, §8 close-out source, Related rescope).
This commit is contained in:
1 parent
a9d45e7012
commit
39b8396794
3 files changed
+41
-4
No files matched your search
@@ -1745,3 +1745,22 @@ every restart since the cutover.
|
||||
[[frank-archon-radiance-swift15-w4dn8]], and the LLM index entry corrected
|
||||
(the w4dn8 entry said STAGED, the fp8-native one said ACTIVE).
|
||||
|
||||
|
||||
## 2026-10-15 — governance: bench removed from the model-change procedure
|
||||
|
||||
- Frank's call: a model swap never carries a bench window. Codified as law:
|
||||
- `AGENTS.md` Benchmarking Policy opens with "Benchmarking is NOT part of
|
||||
the model-swap procedure"; swap verification is the live service (boot
|
||||
ledger, `timings`/`Server-Timing`, one real request per harness role).
|
||||
The stop-and-mask rule stays for DELIBERATE bench windows (flag A/Bs,
|
||||
shape sweeps) — it is host protection (2026-09-16 hard-down precedent),
|
||||
not a swap step. Summary-table row updated to match.
|
||||
- [[Model Swap and Rollback]]: "No bench step (law, 2026-10-15)" up top;
|
||||
§8 close-out numbers must be measured on the live service; the Related
|
||||
link to [[LLM Bench Windows and Measurement]] rescoped to
|
||||
out-of-procedure windows only.
|
||||
- Untouched on purpose: the `FRANK_*_ENV_FILE` hook (staged/out-of-procedure
|
||||
arms), the Fleet Ops Playbook bench-window mechanics (deliberate windows
|
||||
still need the procedure), `deployment.md` (already says bench work is a
|
||||
SEPARATE procedure). Managed skill `llamacpp-endpoint-model-swap` verifies
|
||||
on the live engine — it never had a bench step.
|
||||
Reference in new issue
Block a user