Frank
55f87fcdce
The 2026-10-09 wire aliases become the service names everywhere: systemd units, serve scripts, env files and FRANK_* variables, deploy-plan/deploy-remote service keys, container names, Prometheus job names + alert rules, Grafana dashboard queries, bats seams, runbook filenames, homepage/AGENTS lore, and historical prose. Rollback tags renamed in lockstep. Residue in the tree: zero. Retired frank-medium/small/npu names are history and stay. Known casualty: scripts/patches/*.patch context lines were rewritten; those retired-era vLLM-fork patches no longer apply byte-exact.
1.9 KiB
1.9 KiB
type, title, description, tags, timestamp
| type | title | description | tags | timestamp | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| reference | unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS on Dankclaw (frank-dragoon) | The RETIRED frank-dragoon runbook (2026-09-21, same-day swap; replaced by frank-dragoon-unsloth-qwen38-27b-q8xl) — the unsloth llama.cpp prebuilt (b11030-mix-5ff778e, ROCm gfx1151) serving unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS on the Dankclaw Strix Halo iGPU: the prebuilt runtime, the 200k/one-stream shape, the explicit -md MTP wiring, the payload, the client contract, and the failure modes worth knowing. |
|
2026-09-21 |
frank-dragoon — unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS (RETIRED)
RETIRED 2026-09-21 (same-day swap). This was the ACTIVE frank-dragoon runbook on 2026-09-21 before it was replaced by frank-dragoon-unsloth-qwen38-27b-q8xl (27B dense UD-Q8_K_XL) later the same day. The payload and runtime remain on disk as the rollback target.
What it served
- Runtime: unsloth llama.cpp prebuilt
b11030-mix-5ff778e(ROCm gfx1151), root systemd unit, port 7770. - Model:
unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS(a 125B MoE / 6B active), 87.3 GiB shipped as three split parts. The split parts ARE the payload — concatenating them tripsinvalid split file name(part 1's header advertisesfile_count=3). - Shape: one 200,000-token conversation (single stream), MTP depth 2 via
the explicit
-mdshared-Q8_0 head. Draft acceptance verified live 0.83–0.92. - Memory: the 114 GiB GTT aperture on the Strix Halo iGPU.
Rollback
Payload and runtime intact on disk. See frank-dragoon-unsloth-qwen38-27b-q8xl for the current ACTIVE runbook and frank-dragoon-ciru-orca for the predecessor.
Citations
- unsloth prebuilts: https://huggingface.co/unsloth
- Model: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF