Frank
81e6122891
autoresearch.sh (dev box) scp's the candidate scripts/frank-primary.env + the bench script to dankserver and runs it over ssh. scripts/autoresearch-frank-primary.sh (dankserver) follows the bench policy: stop frank-primary (relink unit: stop, not mask), boot a scratch radiance container (arbench) on the same two cards with the candidate argv, poll /health, run ONE self-contained greedy completion (fixed ~140k-char real-text prompt -> ~32k tokens, 256-token decode), parse the engine timings into METRIC lines, tear the scratch down, and restore production via a trap. Fresh prefix-cache tier per run for cold prefill. Baseline validated: decode_tps=31.70, prefill_tps=465.4, ttft_ms=93745, draft_accept=0.831 at prompt_n=43627.
27 lines
1.4 KiB
Bash
Executable File
27 lines
1.4 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# autoresearch.sh — canonical frank-primary benchmark entry point (dev box).
|
|
#
|
|
# The service runs on dankserver (192.168.0.235:7770), the two R9700s live
|
|
# there, and the benchmark must own those cards, so the whole stop -> boot
|
|
# scratch -> bench -> restore sequence runs ON dankserver (see
|
|
# scripts/autoresearch-frank-primary.sh). This wrapper:
|
|
# 1. copies the candidate config (the repo's scripts/frank-primary.env, the
|
|
# file the autoresearch loop edits) and the bench script to dankserver,
|
|
# 2. runs the bench over ssh, relaying its stdout (the METRIC lines) and
|
|
# exit code back here verbatim.
|
|
# It deliberately does NOT push to origin: the scp dirties dankserver's
|
|
# working tree, and the loop's uncommitted candidate config must not be
|
|
# pushed. Only this file and scripts/autoresearch-frank-primary.sh are
|
|
# committed; the candidate env rides over ssh each run.
|
|
set -uo pipefail
|
|
DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
|
|
REMOTE=dankserver
|
|
REMOTE_REPO=/home/dank/serverAppConfigs
|
|
|
|
scp -q "$DIR/scripts/frank-primary.env" \
|
|
"$REMOTE:$REMOTE_REPO/scripts/frank-primary.env" || { echo "scp env failed" >&2; exit 1; }
|
|
scp -q "$DIR/scripts/autoresearch-frank-primary.sh" \
|
|
"$REMOTE:$REMOTE_REPO/scripts/autoresearch-frank-primary.sh" || { echo "scp script failed" >&2; exit 1; }
|
|
|
|
ssh "$REMOTE" "bash $REMOTE_REPO/scripts/autoresearch-frank-primary.sh $REMOTE_REPO/scripts/frank-primary.env"
|