docs(frank-large): unsloth Qwen3.8-Flash-Next runbook; retire the CIRU Orca runbook
New runbook frank-large-unsloth-qwen38-flash-next.md (runtime, payload, deployed config, the explicit -md, the 114 GiB GTT memory model, client contract, rollback). frank-large-ciru-orca.md marked RETIRED (rollback target, payload and runtime intact on disk). AGENTS.md topology row, frank-large section, harness note, runbook index, and the GPU-budget lesson (GTT aperture ~114 GiB, not the stale 64 GiB rocm-smi figure — the CIRU Orca held 92.6 GiB on the same device). LLM index header, mermaid, active list, and the vault root index updated. Work-log entry.
This commit is contained in:
@@ -11,6 +11,42 @@ timestamp: 2026-09-14
|
||||
|
||||
# Bundle Change Log
|
||||
|
||||
## 2026-09-21 — frank-large: CIRU Orca → unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS
|
||||
|
||||
- **The change.** At the operator's request, frank-large (dankclaw :7770)
|
||||
moves from the CIRU v4.4.1 Orca runtime (jcbtc
|
||||
Qwen3.8-Flash-CIRU-STRIX-Orca, 262144 ctx) to the unsloth llama.cpp
|
||||
prebuilt (b11030-mix-5ff778e, ROCm gfx1151, bundles its own ROCm 7.16)
|
||||
serving `unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS` (87.3 GiB, three HF
|
||||
split parts concatenated), one conversation at 200,000 ctx, MTP depth 2.
|
||||
The fleet contract is unchanged: port 7770, alias `frank-large`,
|
||||
text-only.
|
||||
- **Why the unsloth prebuilt.** The qwen4exp MTP graph exists only in the
|
||||
unsloth fork (stock mainline has no MTP for this architecture); the
|
||||
prebuilt bundles its own ROCm, so there is no host SDK gate or venv the
|
||||
way the CIRU build had one.
|
||||
- **The explicit `-md`.** Sidecar auto-discovery does not search the `mtp/`
|
||||
subfolder — without an explicit `-md <head>`, `--spec-type draft-mtp`
|
||||
silently runs at the main model's speed. The serve script gates on the
|
||||
head's presence and passes it.
|
||||
- **Memory model.** The iGPU's budget is the GTT aperture: 116,732 MiB
|
||||
(~114 GiB), `gtt_total=122402963456` — not the old "64 GiB rocm-smi"
|
||||
lesson (stale: the CIRU Orca held 92.6 GiB on the same device). 200k
|
||||
budget ≈ 100 GiB, ~14 GiB of headroom.
|
||||
- **Verified before cutover.** Gemma4-12B smoke load on the iGPU via the
|
||||
prebuilt: clean completion with reasoning extraction (the first probe
|
||||
returned empty content because the thinking block consumed the 32-token
|
||||
budget — a budget artifact, not a decode failure). CIRU restored for the
|
||||
~3-hour model fetch (health 200 in ~40 s).
|
||||
- **Docs.** New runbook `frank-large-unsloth-qwen38-flash-next.md`;
|
||||
`frank-large-ciru-orca.md` marked RETIRED (rollback target, payload and
|
||||
runtime intact on disk); AGENTS.md topology/section/runbook index and the
|
||||
GPU-budget lesson updated; LLM index header + mermaid + active list
|
||||
updated.
|
||||
- **Files.** `scripts/serve-frank-large.sh`, `scripts/frank-large.env`,
|
||||
`scripts/frank-large.service`, `scripts/download-frank-large-unsloth.sh`,
|
||||
`scripts/deploy-remote.sh`, `tests/frank_large_unit.bats`.
|
||||
|
||||
## 2026-09-21 — node-dankclaw Prometheus target fixed (netavark host-bind quirk)
|
||||
|
||||
- **The gap.** A deep audit found the `node-dankclaw` scrape target red while
|
||||
|
||||
Reference in New Issue
Block a user