Files
serverAppConfigs/serverAppConfigs-docs/LLM/frank-large-unsloth-qwen38-flash-next.md
T
Frank 93d1181fee docs: OKF v0.1 compliance pass + fact-check + 3 research briefs
- Migrate all 127 non-reserved docs to OKF v0.1 frontmatter (type/description/tags/timestamp); fix 13 YAML issues, 2 duplicate-FM blocks, strip reserved-page FM
- Restructure log.md to OKF (## YYYY-MM-DD, newest-first)
- Fact-check against scripts/AGENTS.md ground truth: fix 6 false 'Active' banners on retired runbooks, 96->114 GiB GTT, deployment.md vs deploy-plan.py/deploy-remote.sh, Deployment Flow frank-medium=Quadlet, Calibre 9.9.0->9.15.0 + CVE-2025-7404 conflation, Copyparty v1.20.24, RomM 5.3.0 breaking change
- Move *arr docs to new FrankBook-Pro/ section (git mv, link-safe)
- Write active runbook bodies from ground truth (frank-large, frank-small)
- Add 3 research briefs + HTML report: Local TTS and Voice Cloning, AI Job Search and Resume Tools, Most Popular Self-Hosted AI Apps (Jun-Sep 2026)
- Add upstream-version rows to ComfyUI/OpenWebUI/Hermes app docs
- All 336 tests pass; 136 pages, 0 unresolved wikilinks
2026-09-22 02:09:41 -07:00

1.9 KiB
Raw Blame History

type, title, description, tags, timestamp
type title description tags timestamp
reference unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS on Dankclaw (frank-large) The RETIRED frank-large runbook (2026-09-21, same-day swap; replaced by frank-large-unsloth-qwen38-27b-q8xl) — the unsloth llama.cpp prebuilt (b11030-mix-5ff778e, ROCm gfx1151) serving unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS on the Dankclaw Strix Halo iGPU: the prebuilt runtime, the 200k/one-stream shape, the explicit -md MTP wiring, the payload, the client contract, and the failure modes worth knowing.
llm
unsloth
dankclaw
frank-large
strix-halo
gfx1151
qwen4exp
rocm
mtp
2026-09-21

frank-large — unsloth llama.cpp Qwen3.8-Flash-Next UD-IQ4_XS (RETIRED)

RETIRED 2026-09-21 (same-day swap). This was the ACTIVE frank-large runbook on 2026-09-21 before it was replaced by frank-large-unsloth-qwen38-27b-q8xl (27B dense UD-Q8_K_XL) later the same day. The payload and runtime remain on disk as the rollback target.

What it served

  • Runtime: unsloth llama.cpp prebuilt b11030-mix-5ff778e (ROCm gfx1151), root systemd unit, port 7770.
  • Model: unsloth/Qwen3.8-Flash-Next-GGUF:UD-IQ4_XS (a 125B MoE / 6B active), 87.3 GiB shipped as three split parts. The split parts ARE the payload — concatenating them trips invalid split file name (part 1's header advertises file_count=3).
  • Shape: one 200,000-token conversation (single stream), MTP depth 2 via the explicit -md shared-Q8_0 head. Draft acceptance verified live 0.83–0.92.
  • Memory: the 114 GiB GTT aperture on the Strix Halo iGPU.

Rollback

Payload and runtime intact on disk. See frank-large-unsloth-qwen38-27b-q8xl for the current ACTIVE runbook and frank-large-ciru-orca for the predecessor.

Citations