Frank
8212d4451a
Mechanical identity rename across the knowledge base, AGENTS.md, README, the
hermes config example, and homepage services.json. No behavior change; served
aliases on the LLM endpoints change with the deploy of commit 69f87c8.
1.6 KiB
type, title, description, tags, timestamp
| type | title | description | tags | timestamp | ||||
|---|---|---|---|---|---|---|---|---|
| benchmark plan | frank-large ubatch sweep | Standardized ubatch sweep for the active kingjones Qwen3.8 ROCmFPX deployment. |
|
2026-09-01 |
frank-large ubatch sweep
This benchmark uses the active frank-large model on Dankclaw with
llama-bench. It does not use llama-server, HTTP requests, or server-log
scraping. Stop the production service before running it and start the service
again afterward.
The old custom harnesses are retained in .AGENTTRASH/bench-scripts-20260901/
for auditability only. Their results are invalid and must not be used.
Sweep
The requested points are 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 3072, 4096 at 8K context, with batch equal to ubatch at every point.
Each point runs three 128-token repetitions by default.
Run on Dankclaw from the repository checkout:
sudo systemctl stop frank-large
./scripts/bench-ubatch.sh
sudo systemctl start frank-large
The script uses the active Q6 AGENT model, an 8K prompt workload, equal
batch and ubatch values, and llama-bench JSONL output. The sweep is:
256, 512, 768, 1024, 1280, 1536, 1792, 2048, 3072, 4096
The GPU is shared with live workloads; do not run with the production service up.
Results
No valid results are recorded here. All results from the retired custom
harnesses are explicitly discarded. Record the raw llama-bench JSONL output
from the new harness here after a clean run.