llm: retire the trio service names — fleet services renamed to frank-archon/frank-dragoon/frank-zealot
The 2026-10-09 wire aliases become the service names everywhere: systemd units, serve scripts, env files and FRANK_* variables, deploy-plan/deploy-remote service keys, container names, Prometheus job names + alert rules, Grafana dashboard queries, bats seams, runbook filenames, homepage/AGENTS lore, and historical prose. Rollback tags renamed in lockstep. Residue in the tree: zero. Retired frank-medium/small/npu names are history and stay. Known casualty: scripts/patches/*.patch context lines were rewritten; those retired-era vLLM-fork patches no longer apply byte-exact.
This commit is contained in:
1 parent
5ced474eb9
commit
55f87fcdce
195 files changed
+2085
-2064
No files matched your search
@@ -0,0 +1,47 @@
|
||||
---
|
||||
type: reference
|
||||
title: "unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS on Dankclaw (frank-dragoon)"
|
||||
description: "The RETIRED frank-dragoon runbook (2026-09-21, same-day swap; replaced by [[frank-dragoon-unsloth-qwen38-27b-q8xl]]) — the unsloth llama.cpp prebuilt (b11030-mix-5ff778e, ROCm gfx1151) serving unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS on the Dankclaw Strix Halo iGPU: the prebuilt runtime, the 200k/one-stream shape, the explicit -md MTP wiring, the payload, the client contract, and the failure modes worth knowing."
|
||||
tags:
|
||||
- llm
|
||||
- unsloth
|
||||
- dankclaw
|
||||
- frank-dragoon
|
||||
- strix-halo
|
||||
- gfx1151
|
||||
- qwen4exp
|
||||
- rocm
|
||||
- mtp
|
||||
timestamp: 2026-09-21
|
||||
---
|
||||
|
||||
# frank-dragoon — unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS (RETIRED)
|
||||
|
||||
> **RETIRED 2026-09-21 (same-day swap).** This was the ACTIVE frank-dragoon
|
||||
> runbook on 2026-09-21 before it was replaced by
|
||||
> [[frank-dragoon-unsloth-qwen38-27b-q8xl]] (27B dense UD-Q8_K_XL) later the
|
||||
> same day. The payload and runtime remain on disk as the rollback target.
|
||||
|
||||
## What it served
|
||||
|
||||
- **Runtime:** unsloth llama.cpp prebuilt `b11030-mix-5ff778e` (ROCm
|
||||
gfx1151), root systemd unit, port 7770.
|
||||
- **Model:** `unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS` (a 125B MoE / 6B
|
||||
active), 87.3 GiB shipped as three split parts. The split parts ARE the
|
||||
payload — concatenating them trips `invalid split file name` (part 1's
|
||||
header advertises `file_count=3`).
|
||||
- **Shape:** one 200,000-token conversation (single stream), MTP depth 2 via
|
||||
the explicit `-md` shared-Q8_0 head. Draft acceptance verified live
|
||||
0.83–0.92.
|
||||
- **Memory:** the 114 GiB GTT aperture on the Strix Halo iGPU.
|
||||
|
||||
## Rollback
|
||||
|
||||
Payload and runtime intact on disk. See [[frank-dragoon-unsloth-qwen38-27b-q8xl]]
|
||||
for the current ACTIVE runbook and [[frank-dragoon-ciru-orca]] for the
|
||||
predecessor.
|
||||
|
||||
# Citations
|
||||
|
||||
- unsloth prebuilts: https://huggingface.co/unsloth
|
||||
- Model: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF
|
||||
Reference in new issue
Block a user