Configure DeepSeek reasoning and large-model ubatch sweep

docs/LLM/ubatch-benchmark-large.md

@@ -0,0 +1,59 @@
+---
+type: benchmark plan
+title: frank-default-large ubatch sweep
+description: Standardized ubatch sweep for the active kingjones Qwen3.8 ROCmFPX deployment.
+tags:
+  - llama.cpp
+  - rocm
+  - benchmark
+  - ubatch
+timestamp: 2026-09-01
+---
+
+# frank-default-large ubatch sweep
+
+This benchmark sweeps the active `frank-default-large` model on Dankclaw using
+scratch ports and an 8K-context workload. The production service is stopped
+before the sweep and restarted by the benchmark's exit handler.
+
+## Sweep
+
+The default points are `256, 512, 768, 1024, 1280, 1536, 2048, 3072, 4096,
+5120, 6144`. This implements the requested 256-step range through 1536 and
+1024-step range from 2048 through 6144. Each point runs three 256-token decode
+requests by default.
+
+Run on Dankclaw from the repository checkout:
+
+```bash
+STOPSVC=1 ./scripts/bench-ubatch-rocmi4.sh
+```
+
+The script uses the active Q6 AGENT model, standalone MTP draft, tracked Sharp
+template, and `--reasoning-format deepseek`. It reports server timing lines and
+per-run generation throughput. Run only when the production service can be
+interrupted; the GPU is shared with live workloads.
+
+## Results
+
+Record results below after the sweep, including failures or OOM points.
+
+| ubatch | prefill | generation | notes |
+| ---: | ---: | ---: | --- |
+| 256 | — | — | pending |
+| 512 | — | — | pending |
+| 768 | — | — | pending |
+| 1024 | — | — | pending |
+| 1280 | — | — | pending |
+| 1536 | — | — | pending |
+| 2048 | — | — | pending |
+| 3072 | — | — | pending |
+| 4096 | — | — | pending |
+| 5120 | — | — | pending |
+| 6144 | — | — | pending |
+
+## See also
+
+- [LLM fleet index](index.md)
+- [Deployment](deployment.md)
+- [Active kingjones runbook](kingjones-strix-mtp.md)