Files
serverAppConfigs/serverAppConfigs-docs/LLM/ubatch-benchmark-large.md
T
Frank 219a097b39 docs(vault): one page per endpoint, forever -- 45 era pages fold into three
Every payload swap a live endpoint has ever run is now one row in that
endpoint's Eras table, with its rollback path in the same row. No per-attempt
page, no per-swap ledger, nowhere else.

- Added: LLM/frank-archon.md (radiance, 2x R9700 TP=2), LLM/frank-dragoon.md
  (halogen flash-server, 19 eras), LLM/frank-zealot.md (llama.cpp PrismML fork
  on the 3090). Each carries Current shape, Eras, Laws, wire contract, files.
- Deleted: 45 per-payload runbooks -- the frank-dragoon line (11 including the
  pre-name halogen/kingjones/kairic/CIRU/eemin/agentionai/dflash2 pages and the
  benchmark page), the frank-zealot line (llama.cpp/vLLM/ik_llama/SGLang eras),
  the frank-archon line (vLLM/FreeToken/R9V/llama.cpp/radiance eras), plus
  frank-medium, frank-npu and the ubatch/PCIe one-offs that owned nothing.
- Rewired: every wikilink and markdown-path reference to a folded page points
  at the endpoint page instead; the three Research see-also lists and the
  ubatch sweep's runbook link included. No anchored links existed in the set.
- Regenerated both index pages as pure locators -- one row, one clause, no
  numbers -- so the docs_completeness locator law holds for all 153 pages.

tests/docs_completeness.bats green: index links every page, no unresolved
links. The pages moved to .AGENTTRASH/20261018-doc-dedupe/LLM/ (gitignored,
and git history holds every byte).
2026-10-19 00:49:03 -07:00

1.7 KiB

type, title, description, tags, timestamp
type title description tags timestamp
benchmark plan frank-dragoon ubatch sweep Standardized ubatch sweep for the active kingjones Qwen3.8 ROCmFPX deployment.
llama.cpp
rocm
benchmark
ubatch
2026-09-01

frank-dragoon ubatch sweep

This benchmark uses the active frank-dragoon model on Dankclaw with llama-bench. It does not use llama-server, HTTP requests, or server-log scraping. Stop the production service before running it and start the service again afterward.

The old custom harnesses are retained in .AGENTTRASH/bench-scripts-20260901/ for auditability only. Their results are invalid and must not be used.

Sweep

The requested points are 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 3072, 4096 at 8K context, with batch equal to ubatch at every point. Each point runs three 128-token repetitions by default.

Run on Dankclaw from the repository checkout:

sudo systemctl stop frank-dragoon
./scripts/bench-ubatch.sh
sudo systemctl start frank-dragoon

The script uses the active Q6 AGENT model, an 8K prompt workload, equal batch and ubatch values, and llama-bench JSONL output. The sweep is:

256, 512, 768, 1024, 1280, 1536, 1792, 2048, 3072, 4096

The GPU is shared with live workloads; do not run with the production service up.

Results

No valid results are recorded here. All results from the retired custom harnesses are explicitly discarded. Record the raw llama-bench JSONL output from the new harness here after a clean run.

See also