Revert frank-default-large to CIRU runtime (DFlash2 too slow)

Restore the CIRU ROCmFPX setup that DFlash2 replaced:

- Restore jcbtc/Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2 runtime
  (native depth-4 MTP, PromptForge DualView, ROCm 7.15)
- Archive the DFlash2 Vulkan deployment files in .AGENTTRASH
- DFlash2 was retired the same day it shipped (2026-08-21) for speed
- Revert docs (deployment.md, index.md, AGENTS.md); mark dflash2 page archived
- Restored scripts are byte-identical to the pre-swap CIRU versions
This commit is contained in:
Frank
2026-08-21 10:15:23 -07:00
parent fd0d9dd3cb
commit 583efd8cf2
11 changed files with 316 additions and 302 deletions
+13 -11
View File
@@ -9,7 +9,7 @@ Two servers run LLM inference services. Each server pulls its scripts from this
| Target | Host | Runtime | Service | Port |
|--------|------|---------|---------|------|
| Dankserver | dank@dankserver | upstream llama.cpp (Qwen3.6-35B-A3B Q6_K_P + ngram-mod, MoE on CPU) | frank-default-small | 7770 |
| Dankclaw | dank@dankclaw | upstream llama.cpp PR #27342 DFlash2 (unsloth Qwen3.8-27B-UD-Q8_K_XL + z-lab DFlash2 Q4_K_M drafter, Vulkan, 262K ctx / 1 slot) | frank-default-large | 52625 |
| Dankclaw | dank@dankclaw | CIRU ROCmFPX llama.cpp (jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2, native MTP + PromptForge DualView, 262K ctx / 1 slot) | frank-default-large | 52625 |
## Workflow
@@ -115,19 +115,21 @@ launches through `scripts/serve-frank-small.sh`, which reads tunables from
### Dankclaw — frank-default-large
The active service on Dankclaw is upstream llama.cpp PR #27342 (DFlash2
support) built with GGML_VULKAN=ON, serving
`/home/dank/models/Qwen3.8-27B-UD-Q8_K_XL.gguf` (unsloth Dynamic v3.0,
31.4 GB) under the alias `frank-default-large` on port 52625. It runs
`/home/dank/llama.cpp-dflash2/build-dflash2/bin/llama-server` with a
z-lab DFlash2 drafter (`/home/dank/models/Qwen3.8-27B-DFlash2-Q4_K_M.gguf`,
block size 8) via `--spec-type draft-dflash`, on the Vulkan (RADV) backend
(`Vulkan0`, gfx1151, 113942 MiB). f16 KV for both K and V, full 262144
context (1 slot), batch 4096 / ubatch 4096, 16 context checkpoints, 8 GiB
The active service on Dankclaw is the CIRU ROCmFPX llama.cpp runtime serving
`jcbtc/Qwen3.8-27B-CIRU-ActiveFPX-PromptForge` (v2 GGUF + FFN/GDN
companions) under the alias `frank-default-large` on port 52625. It runs
`/home/dank/ciru-qwen38/ROCmFPX/build-promptforge/bin/llama-server` (ROCm
7.15 SDK in the retired ling3-ciru venv) with native depth-4 MTP
(`--spec-type draft-mtp`), f16 KV for both K and V, full 262144 context
(1 slot; concurrent requests queue, the server never preempts a running
generation), batch 4096 / ubatch 4096, 16 context checkpoints, 8 GiB
prompt cache, and reasoning in deepseek format. The unit file is
`scripts/frank-default-large.service`. It launches through
`scripts/serve-frank-large.sh`, which reads tunables from
`scripts/frank-default-large.env`. See [[dflash2-large-vulkan]].
`scripts/frank-default-large.env`. See [[ciru-activefpx-promptforge]].
> Restored 2026-08-21. The intermediate DFlash2 Vulkan deployment was
> retired the same day; see [[dflash2-large-vulkan]] for the archived runbook.
## Validation
+10 -6
View File
@@ -1,7 +1,7 @@
---
type: reference
title: DFlash2 on Dankclaw (frank-default-large)
description: unsloth Qwen3.8-27B-UD-Q8_K_XL served by upstream llama.cpp PR #27342 with a z-lab DFlash2 drafter on the Vulkan backend. Install runbook and the frank-default-large service.
description: ARCHIVED - unsloth Qwen3.8-27B-UD-Q8_K_XL served by upstream llama.cpp PR #27342 with a z-lab DFlash2 drafter on the Vulkan backend. Retired 2026-08-21 for speed; kept as a runbook.
tags:
- llama.cpp
- vulkan
@@ -13,12 +13,16 @@ tags:
timestamp: 2026-08-21
---
# DFlash2 on Dankclaw (frank-default-large)
# DFlash2 on Dankclaw (frank-default-large) — ARCHIVED
`frank-default-large` (port 52625) serves
> **Archived 2026-08-21.** This DFlash2 Vulkan deployment was retired the
> same day it shipped because it was slower than the CIRU runtime it
> replaced. `frank-default-large` is back on CIRU. This page stays as the
> runbook and provenance for the DFlash2 attempt.
`frank-default-large` (port 52625) briefly served
`unsloth/Qwen3.8-27B-UD-Q8_K_XL` with a DFlash2 drafter from z-lab. The
runtime is upstream llama.cpp PR #27342 built with `GGML_VULKAN=ON`.
This deployment replaced the CIRU HIP runtime on 2026-08-21.
runtime was upstream llama.cpp PR #27342 built with `GGML_VULKAN=ON`.
## Why Vulkan
@@ -163,8 +167,8 @@ is close.
## See Also
- [[ciru-activefpx-promptforge]] — the active CIRU runtime on Dankclaw
- [[DFlash DSpark Speculative Decoding]] — DFlash/DSpark design and history
- [[ciru-activefpx-promptforge]] — the retired CIRU runtime (archived)
- [[deployment]] — the deployment and update process
- [[qwen3.8-strix-optimizations]] — llama.cpp Optimizations on this iGPU
- [[index]] — knowledge base index
+12 -13
View File
@@ -2,7 +2,7 @@
Documentation for the LLM inference fleet on two local machines
(2026-08-21): upstream llama.cpp on Dankserver (frank-default-small) and
upstream llama.cpp PR #27342 DFlash2 on Dankclaw (frank-default-large).
CIRU ROCmFPX llama.cpp on Dankclaw (frank-default-large).
## Deployment Topology
@@ -19,11 +19,10 @@ ngram-mod, 36 MoE experts on CPU, 700K ctx]
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
D[gfx1151 iGPU 64 GiB unified memory]
E[upstream llama.cpp PR #27342 DFlash2, Vulkan
E[CIRU ROCmFPX llama.cpp
frank-default-large, port 52625]
F[unsloth Qwen3.8-27B-UD-Q8_K_XL +
z-lab Qwen3.8-27B-DFlash2-Q4_K_M drafter
262K ctx / 1 slot, DFlash2 spec]
F[jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge
262K ctx / 1 slot, native MTP, PromptForge DualView]
D --> E --> F
end
@@ -42,20 +41,20 @@ z-lab Qwen3.8-27B-DFlash2-Q4_K_M drafter
- [[deployment]] — deploy and update process for both servers
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
- [[dflash2-large-vulkan]] — the DFlash2 runtime on Dankclaw
(frank-default-large, Vulkan)
- [[ciru-activefpx-promptforge]] — the CIRU runtime on Dankclaw
(frank-default-large)
- [[Dankserver]] — the upstream llama.cpp box (frank-default-small)
- [[Dankclaw]] — the DFlash2 Vulkan box (frank-default-large)
- [[Dankclaw]] — the CIRU ROCmFPX box (frank-default-large)
## DFlash2 Reference (Dankclaw)
## CIRU Reference (Dankclaw)
- [[dflash2-large-vulkan]] — DFlash2 model, Vulkan build, build runbook,
- [[ciru-activefpx-promptforge]] — model, ROCm 7.15 toolchain, build,
and the frank-default-large service
## CIRU Reference (retired)
## DFlash2 Reference (archived)
- [[ciru-activefpx-promptforge]] — the retired CIRU ROCmFPX runtime
(archived in .AGENTTRASH, 2026-08-21)
- [[dflash2-large-vulkan]] — the retired DFlash2 Vulkan deployment
(2026-08-21)
## vLLM Reference (historical)