AGENTS: MANDATORY benchmarking policy - stop production service before any bench (serves ~3 real users); restart + health-check after

AGENTS.md

@@ -4,6 +4,25 @@
 
 This project manages deployment scripts for two LLM inference servers. Dankclaw runs a llama.cpp service for Qwen3.6-27B (HauhauCS uncensored Q8_K_P) with an MTP sidecar drafter (`draft-mtp`, 3 parallel slots, port 7770). Dankserver runs a llama.cpp service for Qwen3.6-35B-A3B (HauhauCS uncensored Q6_K_P) with ngram-mod speculative decoding and CPU-offloaded MoE experts. See [docs/deployment.md](docs/deployment.md) for the full deployment and update process, and [docs/frank-default-large-benchmark.md](docs/frank-default-large-benchmark.md) for the spec decision (DFlash retired 2026-08-14 due to a parallel premature-EOS bug).
 
+## Benchmarking Policy (MANDATORY)
+
+**STOP the production service BEFORE running any benchmark on a target.**
+These servers serve real users (about 3 people). Running a bench while the
+service is up starves the GPU and corrupts results. Restart the service
+when the bench finishes. The users will call if they need the model.
+
+Rules:
+
+1. Stop the service before any benchmark: `systemctl stop frank-default-large`
+   (Dankclaw) or `systemctl stop frank-default-small` (Dankserver). Use the
+   passwordless helper or the password `Assface.3241` with `sudo -S`.
+2. Run the bench on a scratch port (never the service port 7770).
+3. Restart the service when the bench completes: `systemctl start <svc>`.
+4. Verify health before reporting: `curl http://127.0.0.1:7770/health`.
+
+Do not skip this policy. A stale GPU contention or a dead production box is
+worse than a slow bench.
+
 ## Git Workflow
 
 All script edits must flow through git. Do not edit files on the remote machine directly.