Revert frank-default-large to CIRU runtime (DFlash2 too slow)
Restore the CIRU ROCmFPX setup that DFlash2 replaced: - Restore jcbtc/Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2 runtime (native depth-4 MTP, PromptForge DualView, ROCm 7.15) - Archive the DFlash2 Vulkan deployment files in .AGENTTRASH - DFlash2 was retired the same day it shipped (2026-08-21) for speed - Revert docs (deployment.md, index.md, AGENTS.md); mark dflash2 page archived - Restored scripts are byte-identical to the pre-swap CIRU versions
This commit is contained in:
+13
-11
@@ -9,7 +9,7 @@ Two servers run LLM inference services. Each server pulls its scripts from this
|
||||
| Target | Host | Runtime | Service | Port |
|
||||
|--------|------|---------|---------|------|
|
||||
| Dankserver | dank@dankserver | upstream llama.cpp (Qwen3.6-35B-A3B Q6_K_P + ngram-mod, MoE on CPU) | frank-default-small | 7770 |
|
||||
| Dankclaw | dank@dankclaw | upstream llama.cpp PR #27342 DFlash2 (unsloth Qwen3.8-27B-UD-Q8_K_XL + z-lab DFlash2 Q4_K_M drafter, Vulkan, 262K ctx / 1 slot) | frank-default-large | 52625 |
|
||||
| Dankclaw | dank@dankclaw | CIRU ROCmFPX llama.cpp (jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2, native MTP + PromptForge DualView, 262K ctx / 1 slot) | frank-default-large | 52625 |
|
||||
|
||||
## Workflow
|
||||
|
||||
@@ -115,19 +115,21 @@ launches through `scripts/serve-frank-small.sh`, which reads tunables from
|
||||
|
||||
### Dankclaw — frank-default-large
|
||||
|
||||
The active service on Dankclaw is upstream llama.cpp PR #27342 (DFlash2
|
||||
support) built with GGML_VULKAN=ON, serving
|
||||
`/home/dank/models/Qwen3.8-27B-UD-Q8_K_XL.gguf` (unsloth Dynamic v3.0,
|
||||
31.4 GB) under the alias `frank-default-large` on port 52625. It runs
|
||||
`/home/dank/llama.cpp-dflash2/build-dflash2/bin/llama-server` with a
|
||||
z-lab DFlash2 drafter (`/home/dank/models/Qwen3.8-27B-DFlash2-Q4_K_M.gguf`,
|
||||
block size 8) via `--spec-type draft-dflash`, on the Vulkan (RADV) backend
|
||||
(`Vulkan0`, gfx1151, 113942 MiB). f16 KV for both K and V, full 262144
|
||||
context (1 slot), batch 4096 / ubatch 4096, 16 context checkpoints, 8 GiB
|
||||
The active service on Dankclaw is the CIRU ROCmFPX llama.cpp runtime serving
|
||||
`jcbtc/Qwen3.8-27B-CIRU-ActiveFPX-PromptForge` (v2 GGUF + FFN/GDN
|
||||
companions) under the alias `frank-default-large` on port 52625. It runs
|
||||
`/home/dank/ciru-qwen38/ROCmFPX/build-promptforge/bin/llama-server` (ROCm
|
||||
7.15 SDK in the retired ling3-ciru venv) with native depth-4 MTP
|
||||
(`--spec-type draft-mtp`), f16 KV for both K and V, full 262144 context
|
||||
(1 slot; concurrent requests queue, the server never preempts a running
|
||||
generation), batch 4096 / ubatch 4096, 16 context checkpoints, 8 GiB
|
||||
prompt cache, and reasoning in deepseek format. The unit file is
|
||||
`scripts/frank-default-large.service`. It launches through
|
||||
`scripts/serve-frank-large.sh`, which reads tunables from
|
||||
`scripts/frank-default-large.env`. See [[dflash2-large-vulkan]].
|
||||
`scripts/frank-default-large.env`. See [[ciru-activefpx-promptforge]].
|
||||
|
||||
> Restored 2026-08-21. The intermediate DFlash2 Vulkan deployment was
|
||||
> retired the same day; see [[dflash2-large-vulkan]] for the archived runbook.
|
||||
|
||||
## Validation
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
---
|
||||
type: reference
|
||||
title: DFlash2 on Dankclaw (frank-default-large)
|
||||
description: unsloth Qwen3.8-27B-UD-Q8_K_XL served by upstream llama.cpp PR #27342 with a z-lab DFlash2 drafter on the Vulkan backend. Install runbook and the frank-default-large service.
|
||||
description: ARCHIVED - unsloth Qwen3.8-27B-UD-Q8_K_XL served by upstream llama.cpp PR #27342 with a z-lab DFlash2 drafter on the Vulkan backend. Retired 2026-08-21 for speed; kept as a runbook.
|
||||
tags:
|
||||
- llama.cpp
|
||||
- vulkan
|
||||
@@ -13,12 +13,16 @@ tags:
|
||||
timestamp: 2026-08-21
|
||||
---
|
||||
|
||||
# DFlash2 on Dankclaw (frank-default-large)
|
||||
# DFlash2 on Dankclaw (frank-default-large) — ARCHIVED
|
||||
|
||||
`frank-default-large` (port 52625) serves
|
||||
> **Archived 2026-08-21.** This DFlash2 Vulkan deployment was retired the
|
||||
> same day it shipped because it was slower than the CIRU runtime it
|
||||
> replaced. `frank-default-large` is back on CIRU. This page stays as the
|
||||
> runbook and provenance for the DFlash2 attempt.
|
||||
|
||||
`frank-default-large` (port 52625) briefly served
|
||||
`unsloth/Qwen3.8-27B-UD-Q8_K_XL` with a DFlash2 drafter from z-lab. The
|
||||
runtime is upstream llama.cpp PR #27342 built with `GGML_VULKAN=ON`.
|
||||
This deployment replaced the CIRU HIP runtime on 2026-08-21.
|
||||
runtime was upstream llama.cpp PR #27342 built with `GGML_VULKAN=ON`.
|
||||
|
||||
## Why Vulkan
|
||||
|
||||
@@ -163,8 +167,8 @@ is close.
|
||||
|
||||
## See Also
|
||||
|
||||
- [[ciru-activefpx-promptforge]] — the active CIRU runtime on Dankclaw
|
||||
- [[DFlash DSpark Speculative Decoding]] — DFlash/DSpark design and history
|
||||
- [[ciru-activefpx-promptforge]] — the retired CIRU runtime (archived)
|
||||
- [[deployment]] — the deployment and update process
|
||||
- [[qwen3.8-strix-optimizations]] — llama.cpp Optimizations on this iGPU
|
||||
- [[index]] — knowledge base index
|
||||
|
||||
+12
-13
@@ -2,7 +2,7 @@
|
||||
|
||||
Documentation for the LLM inference fleet on two local machines
|
||||
(2026-08-21): upstream llama.cpp on Dankserver (frank-default-small) and
|
||||
upstream llama.cpp PR #27342 DFlash2 on Dankclaw (frank-default-large).
|
||||
CIRU ROCmFPX llama.cpp on Dankclaw (frank-default-large).
|
||||
|
||||
## Deployment Topology
|
||||
|
||||
@@ -19,11 +19,10 @@ ngram-mod, 36 MoE experts on CPU, 700K ctx]
|
||||
|
||||
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
|
||||
D[gfx1151 iGPU 64 GiB unified memory]
|
||||
E[upstream llama.cpp PR #27342 DFlash2, Vulkan
|
||||
E[CIRU ROCmFPX llama.cpp
|
||||
frank-default-large, port 52625]
|
||||
F[unsloth Qwen3.8-27B-UD-Q8_K_XL +
|
||||
z-lab Qwen3.8-27B-DFlash2-Q4_K_M drafter
|
||||
262K ctx / 1 slot, DFlash2 spec]
|
||||
F[jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge
|
||||
262K ctx / 1 slot, native MTP, PromptForge DualView]
|
||||
D --> E --> F
|
||||
end
|
||||
|
||||
@@ -42,20 +41,20 @@ z-lab Qwen3.8-27B-DFlash2-Q4_K_M drafter
|
||||
|
||||
- [[deployment]] — deploy and update process for both servers
|
||||
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
|
||||
- [[dflash2-large-vulkan]] — the DFlash2 runtime on Dankclaw
|
||||
(frank-default-large, Vulkan)
|
||||
- [[ciru-activefpx-promptforge]] — the CIRU runtime on Dankclaw
|
||||
(frank-default-large)
|
||||
- [[Dankserver]] — the upstream llama.cpp box (frank-default-small)
|
||||
- [[Dankclaw]] — the DFlash2 Vulkan box (frank-default-large)
|
||||
- [[Dankclaw]] — the CIRU ROCmFPX box (frank-default-large)
|
||||
|
||||
## DFlash2 Reference (Dankclaw)
|
||||
## CIRU Reference (Dankclaw)
|
||||
|
||||
- [[dflash2-large-vulkan]] — DFlash2 model, Vulkan build, build runbook,
|
||||
- [[ciru-activefpx-promptforge]] — model, ROCm 7.15 toolchain, build,
|
||||
and the frank-default-large service
|
||||
|
||||
## CIRU Reference (retired)
|
||||
## DFlash2 Reference (archived)
|
||||
|
||||
- [[ciru-activefpx-promptforge]] — the retired CIRU ROCmFPX runtime
|
||||
(archived in .AGENTTRASH, 2026-08-21)
|
||||
- [[dflash2-large-vulkan]] — the retired DFlash2 Vulkan deployment
|
||||
(2026-08-21)
|
||||
|
||||
## vLLM Reference (historical)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user