Frank
55f87fcdce
The 2026-10-09 wire aliases become the service names everywhere: systemd units, serve scripts, env files and FRANK_* variables, deploy-plan/deploy-remote service keys, container names, Prometheus job names + alert rules, Grafana dashboard queries, bats seams, runbook filenames, homepage/AGENTS lore, and historical prose. Rollback tags renamed in lockstep. Residue in the tree: zero. Retired frank-medium/small/npu names are history and stay. Known casualty: scripts/patches/*.patch context lines were rewritten; those retired-era vLLM-fork patches no longer apply byte-exact.
48 lines
1.9 KiB
Markdown
48 lines
1.9 KiB
Markdown
---
|
||
type: reference
|
||
title: "unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS on Dankclaw (frank-dragoon)"
|
||
description: "The RETIRED frank-dragoon runbook (2026-09-21, same-day swap; replaced by [[frank-dragoon-unsloth-qwen38-27b-q8xl]]) — the unsloth llama.cpp prebuilt (b11030-mix-5ff778e, ROCm gfx1151) serving unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS on the Dankclaw Strix Halo iGPU: the prebuilt runtime, the 200k/one-stream shape, the explicit -md MTP wiring, the payload, the client contract, and the failure modes worth knowing."
|
||
tags:
|
||
- llm
|
||
- unsloth
|
||
- dankclaw
|
||
- frank-dragoon
|
||
- strix-halo
|
||
- gfx1151
|
||
- qwen4exp
|
||
- rocm
|
||
- mtp
|
||
timestamp: 2026-09-21
|
||
---
|
||
|
||
# frank-dragoon — unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS (RETIRED)
|
||
|
||
> **RETIRED 2026-09-21 (same-day swap).** This was the ACTIVE frank-dragoon
|
||
> runbook on 2026-09-21 before it was replaced by
|
||
> [[frank-dragoon-unsloth-qwen38-27b-q8xl]] (27B dense UD-Q8_K_XL) later the
|
||
> same day. The payload and runtime remain on disk as the rollback target.
|
||
|
||
## What it served
|
||
|
||
- **Runtime:** unsloth llama.cpp prebuilt `b11030-mix-5ff778e` (ROCm
|
||
gfx1151), root systemd unit, port 7770.
|
||
- **Model:** `unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS` (a 125B MoE / 6B
|
||
active), 87.3 GiB shipped as three split parts. The split parts ARE the
|
||
payload — concatenating them trips `invalid split file name` (part 1's
|
||
header advertises `file_count=3`).
|
||
- **Shape:** one 200,000-token conversation (single stream), MTP depth 2 via
|
||
the explicit `-md` shared-Q8_0 head. Draft acceptance verified live
|
||
0.83–0.92.
|
||
- **Memory:** the 114 GiB GTT aperture on the Strix Halo iGPU.
|
||
|
||
## Rollback
|
||
|
||
Payload and runtime intact on disk. See [[frank-dragoon-unsloth-qwen38-27b-q8xl]]
|
||
for the current ACTIVE runbook and [[frank-dragoon-ciru-orca]] for the
|
||
predecessor.
|
||
|
||
# Citations
|
||
|
||
- unsloth prebuilts: https://huggingface.co/unsloth
|
||
- Model: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF
|