docs: record fleet double swap (large -> kingjones STRIX on pinned fork, small -> Huihui FP8 on FreeToken)
- kingjones-strix-rocmfp4 reactivated as the ACTIVE large runbook: runtime build recipe (WEBUI=OFF gotcha), deployed serving profile, fa-on-works-unpatched evidence, MTP heads documented unloadable, swap procedure + 2026-08-30 validation record - agentionai-fast-imatrix marked RETIRED (rollback record kept) - freetoken-frank-default-small: model/lineage/template sections now Huihui abliterated FP8; new operational quirk: chat API 422 without explicit model field - LLM index + AGENTS fleet table/runtime sections current; both services' history chains fixed (small was still Tiel in AGENTS.md) - worklog entry added; models.json contextWindow for large corrected to the real per-slot 131072 (llama clamps n_ctx_train/parallel)
This commit is contained in:
1 parent
aa9c1d065a
commit
0937cfb047
6 files changed
+268
-152
No files matched your search
@@ -17,17 +17,21 @@ timestamp: 2026-08-29
|
||||
|
||||
# agentionai Qwen3.8-Flash-Next ROCmFP4-FAST imatrix on Dankclaw
|
||||
|
||||
> **Active since 2026-08-29.** Replaced the kingjones STRIX_LEAN and jcbtc
|
||||
> CIRU v1.1 deployments on the same slot.
|
||||
> **MTP draft disabled** — the author's own head does not load on
|
||||
> build-qwen38 (see Known issues #3). Speculative decoding is ngram-mod only.
|
||||
> **RETIRED 2026-08-30** — replaced by the kingjones STRIX model on the
|
||||
> card's pinned kingjones30/ROCmFPX runtime; see
|
||||
> [[kingjones-strix-rocmfp4]] for the active runbook. This page stays as
|
||||
> the deployment record: the v2-joined-PLE layout requirement, the MTP
|
||||
> head incompatibility (verified 3x), and the QSA F32-mask patch
|
||||
> (`scripts/patches/qwen4exp-qsa-f32-mask.patch`) that made
|
||||
> `--flash-attn on` work on the charlie build-qwen38 tree — all still
|
||||
> true for that binary + model pair, which remains the rollback target.
|
||||
|
||||
`frank-default-large` (port 7770) serves
|
||||
`frank-default-large` (port 7770) served
|
||||
`agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF` (main,
|
||||
`Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-v2.gguf`, the `v2/` joined layout)
|
||||
with the author's own MTP draft head
|
||||
(`Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST.gguf`) on the
|
||||
charlie12345/ROCmFPX `build-qwen38` runtime.
|
||||
(`Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST.gguf`, never loaded) on the
|
||||
charlie12345/ROCmFPX `build-qwen38` runtime, 2026-08-29 → 2026-08-30.
|
||||
|
||||
## Why this model
|
||||
|
||||
|
||||
Reference in new issue
Block a user