Frank
93d1181fee
- Migrate all 127 non-reserved docs to OKF v0.1 frontmatter (type/description/tags/timestamp); fix 13 YAML issues, 2 duplicate-FM blocks, strip reserved-page FM - Restructure log.md to OKF (## YYYY-MM-DD, newest-first) - Fact-check against scripts/AGENTS.md ground truth: fix 6 false 'Active' banners on retired runbooks, 96->114 GiB GTT, deployment.md vs deploy-plan.py/deploy-remote.sh, Deployment Flow frank-medium=Quadlet, Calibre 9.9.0->9.15.0 + CVE-2025-7404 conflation, Copyparty v1.20.24, RomM 5.3.0 breaking change - Move *arr docs to new FrankBook-Pro/ section (git mv, link-safe) - Write active runbook bodies from ground truth (frank-large, frank-small) - Add 3 research briefs + HTML report: Local TTS and Voice Cloning, AI Job Search and Resume Tools, Most Popular Self-Hosted AI Apps (Jun-Sep 2026) - Add upstream-version rows to ComfyUI/OpenWebUI/Hermes app docs - All 336 tests pass; 136 pages, 0 unresolved wikilinks
48 lines
1.9 KiB
Markdown
48 lines
1.9 KiB
Markdown
---
|
||
type: reference
|
||
title: "unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS on Dankclaw (frank-large)"
|
||
description: "The RETIRED frank-large runbook (2026-09-21, same-day swap; replaced by [[frank-large-unsloth-qwen38-27b-q8xl]]) — the unsloth llama.cpp prebuilt (b11030-mix-5ff778e, ROCm gfx1151) serving unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS on the Dankclaw Strix Halo iGPU: the prebuilt runtime, the 200k/one-stream shape, the explicit -md MTP wiring, the payload, the client contract, and the failure modes worth knowing."
|
||
tags:
|
||
- llm
|
||
- unsloth
|
||
- dankclaw
|
||
- frank-large
|
||
- strix-halo
|
||
- gfx1151
|
||
- qwen4exp
|
||
- rocm
|
||
- mtp
|
||
timestamp: 2026-09-21
|
||
---
|
||
|
||
# frank-large — unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS (RETIRED)
|
||
|
||
> **RETIRED 2026-09-21 (same-day swap).** This was the ACTIVE frank-large
|
||
> runbook on 2026-09-21 before it was replaced by
|
||
> [[frank-large-unsloth-qwen38-27b-q8xl]] (27B dense UD-Q8_K_XL) later the
|
||
> same day. The payload and runtime remain on disk as the rollback target.
|
||
|
||
## What it served
|
||
|
||
- **Runtime:** unsloth llama.cpp prebuilt `b11030-mix-5ff778e` (ROCm
|
||
gfx1151), root systemd unit, port 7770.
|
||
- **Model:** `unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS` (a 125B MoE / 6B
|
||
active), 87.3 GiB shipped as three split parts. The split parts ARE the
|
||
payload — concatenating them trips `invalid split file name` (part 1's
|
||
header advertises `file_count=3`).
|
||
- **Shape:** one 200,000-token conversation (single stream), MTP depth 2 via
|
||
the explicit `-md` shared-Q8_0 head. Draft acceptance verified live
|
||
0.83–0.92.
|
||
- **Memory:** the 114 GiB GTT aperture on the Strix Halo iGPU.
|
||
|
||
## Rollback
|
||
|
||
Payload and runtime intact on disk. See [[frank-large-unsloth-qwen38-27b-q8xl]]
|
||
for the current ACTIVE runbook and [[frank-large-ciru-orca]] for the
|
||
predecessor.
|
||
|
||
# Citations
|
||
|
||
- unsloth prebuilts: https://huggingface.co/unsloth
|
||
- Model: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF
|