Frank
219a097b39
Every payload swap a live endpoint has ever run is now one row in that endpoint's Eras table, with its rollback path in the same row. No per-attempt page, no per-swap ledger, nowhere else. - Added: LLM/frank-archon.md (radiance, 2x R9700 TP=2), LLM/frank-dragoon.md (halogen flash-server, 19 eras), LLM/frank-zealot.md (llama.cpp PrismML fork on the 3090). Each carries Current shape, Eras, Laws, wire contract, files. - Deleted: 45 per-payload runbooks -- the frank-dragoon line (11 including the pre-name halogen/kingjones/kairic/CIRU/eemin/agentionai/dflash2 pages and the benchmark page), the frank-zealot line (llama.cpp/vLLM/ik_llama/SGLang eras), the frank-archon line (vLLM/FreeToken/R9V/llama.cpp/radiance eras), plus frank-medium, frank-npu and the ubatch/PCIe one-offs that owned nothing. - Rewired: every wikilink and markdown-path reference to a folded page points at the endpoint page instead; the three Research see-also lists and the ubatch sweep's runbook link included. No anchored links existed in the set. - Regenerated both index pages as pure locators -- one row, one clause, no numbers -- so the docs_completeness locator law holds for all 153 pages. tests/docs_completeness.bats green: index links every page, no unresolved links. The pages moved to .AGENTTRASH/20261018-doc-dedupe/LLM/ (gitignored, and git history holds every byte).
57 lines
1.7 KiB
Markdown
57 lines
1.7 KiB
Markdown
---
|
|
type: benchmark plan
|
|
title: frank-dragoon ubatch sweep
|
|
description: Standardized ubatch sweep for the active kingjones Qwen3.8 ROCmFPX deployment.
|
|
tags:
|
|
- llama.cpp
|
|
- rocm
|
|
- benchmark
|
|
- ubatch
|
|
timestamp: 2026-09-01
|
|
---
|
|
|
|
# frank-dragoon ubatch sweep
|
|
|
|
This benchmark uses the active `frank-dragoon` model on Dankclaw with
|
|
`llama-bench`. It does not use `llama-server`, HTTP requests, or server-log
|
|
scraping. Stop the production service before running it and start the service
|
|
again afterward.
|
|
|
|
The old custom harnesses are retained in `.AGENTTRASH/bench-scripts-20260901/`
|
|
for auditability only. Their results are invalid and must not be used.
|
|
|
|
## Sweep
|
|
|
|
The requested points are `256, 512, 768, 1024, 1280, 1536, 1792, 2048,
|
|
3072, 4096` at 8K context, with `batch` equal to `ubatch` at every point.
|
|
Each point runs three 128-token repetitions by default.
|
|
|
|
Run on Dankclaw from the repository checkout:
|
|
|
|
```bash
|
|
sudo systemctl stop frank-dragoon
|
|
./scripts/bench-ubatch.sh
|
|
sudo systemctl start frank-dragoon
|
|
```
|
|
|
|
The script uses the active Q6 AGENT model, an 8K prompt workload, equal
|
|
`batch` and `ubatch` values, and `llama-bench` JSONL output. The sweep is:
|
|
```text
|
|
256, 512, 768, 1024, 1280, 1536, 1792, 2048, 3072, 4096
|
|
```
|
|
|
|
The GPU is shared with live workloads; do not run with the production service
|
|
up.
|
|
|
|
## Results
|
|
|
|
No valid results are recorded here. All results from the retired custom
|
|
harnesses are explicitly discarded. Record the raw `llama-bench` JSONL output
|
|
from the new harness here after a clean run.
|
|
|
|
## See also
|
|
|
|
- [LLM fleet index](index.md)
|
|
- [Deployment](deployment.md)
|
|
- [[frank-dragoon]] — the kingjones MTP era this sweep ran against is an Eras row there (its page was folded in 2026-10-18)
|