From 2d7290a2a85fcfdcfb5c3e395dad8d6f8a79f711 Mon Sep 17 00:00:00 2001 From: Frank Date: Fri, 14 Aug 2026 20:54:34 -0700 Subject: [PATCH] AGENTS: MANDATORY benchmarking policy - stop production service before any bench (serves ~3 real users); restart + health-check after --- AGENTS.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/AGENTS.md b/AGENTS.md index bb4a12b..df34e86 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -4,6 +4,25 @@ This project manages deployment scripts for two LLM inference servers. Dankclaw runs a llama.cpp service for Qwen3.6-27B (HauhauCS uncensored Q8_K_P) with an MTP sidecar drafter (`draft-mtp`, 3 parallel slots, port 7770). Dankserver runs a llama.cpp service for Qwen3.6-35B-A3B (HauhauCS uncensored Q6_K_P) with ngram-mod speculative decoding and CPU-offloaded MoE experts. See [docs/deployment.md](docs/deployment.md) for the full deployment and update process, and [docs/frank-default-large-benchmark.md](docs/frank-default-large-benchmark.md) for the spec decision (DFlash retired 2026-08-14 due to a parallel premature-EOS bug). +## Benchmarking Policy (MANDATORY) + +**STOP the production service BEFORE running any benchmark on a target.** +These servers serve real users (about 3 people). Running a bench while the +service is up starves the GPU and corrupts results. Restart the service +when the bench finishes. The users will call if they need the model. + +Rules: + +1. Stop the service before any benchmark: `systemctl stop frank-default-large` + (Dankclaw) or `systemctl stop frank-default-small` (Dankserver). Use the + passwordless helper or the password `Assface.3241` with `sudo -S`. +2. Run the bench on a scratch port (never the service port 7770). +3. Restart the service when the bench completes: `systemctl start `. +4. Verify health before reporting: `curl http://127.0.0.1:7770/health`. + +Do not skip this policy. A stale GPU contention or a dead production box is +worse than a slow bench. + ## Git Workflow All script edits must flow through git. Do not edit files on the remote machine directly.