docs(vault): era-correct the vLLM/Ling era pages (cluster C3)
- `Running Qwen3.6 27B FP8 on Dankclaw`: had no banner at all and opened as a live how-to. Added the RETIRED banner (iGPU endpoint today is [[frank-dragoon]]), era-tagged the hardware table, and rewrote the "primary service now runs vLLM-ROCm with Ling CIRU INT4" production note, which was false by three fleet generations. - `ling-3.0-flash-vllm-plan`: "frank-dragoon is the Qwen3.8-27B PP head" -> past tense with the 2026-08-17 redo as the anchor and the live owner named. - `frank-redo-2026-08-17` banner: stripped restated live shapes that had already drifted (radiance 1.0.13, PrismML b10754 - the fleet runs 10777) and the 3090-provenance clause owned by the PP deployment page; banner is now locator-only (names + ports + links). Verified before cutting: 457.9 t/s and the ping-RTT figures are solo-held by Ethernet Bandwidth Math.md (no duplicate), so both scout-reported "duplicates" were kept. Refs: vault de-dup campaign, cluster C3.
This commit is contained in:
1 parent
e32df1b04f
commit
73fb27254e
3 files changed
+21
-12
No files matched your search
@@ -7,6 +7,12 @@ timestamp: 2026-09-03
|
|||||||
---
|
---
|
||||||
|
|
||||||
# Running Qwen3.6 27B FP8 on Dankclaw
|
# Running Qwen3.6 27B FP8 on Dankclaw
|
||||||
|
> **RETIRED - vLLM era (before the 2026-08-17 redo).** Nothing on this page serves
|
||||||
|
> today: no vLLM or ROCm process runs on Dankclaw, and the iGPU endpoint at
|
||||||
|
> `192.168.0.143:7770` is [[frank-dragoon]] (halogen flash-server). The page stays as
|
||||||
|
> the era record of the Qwen3.6-27B-FP8 vLLM bring-up and the Strix Halo ROCm
|
||||||
|
> recipes ([[frank-redo-2026-08-17]]). The hardware table below carries the era's
|
||||||
|
> host figures; live ones are [[Dankclaw System Specs]].
|
||||||
|
|
||||||
## Model Information
|
## Model Information
|
||||||
|
|
||||||
@@ -29,6 +35,7 @@ Qwen3.6-27B is a dense vision-language model from the Qwen3.6 series. It uses 27
|
|||||||
| Vision Encoder | Yes (image-text-to-text) |
|
| Vision Encoder | Yes (image-text-to-text) |
|
||||||
|
|
||||||
## Hardware: Dankclaw
|
## Hardware: Dankclaw
|
||||||
|
*Era figures (2026-08). The host has changed since - [[Dankclaw System Specs]].*
|
||||||
|
|
||||||
| Property | Value |
|
| Property | Value |
|
||||||
|----------|-------|
|
|----------|-------|
|
||||||
@@ -55,7 +62,11 @@ The FP8 variant requires approximately 16-17 GB. ThinkingCap-FP8 requires ~29 GB
|
|||||||
|
|
||||||
## Prerequisites
|
## Prerequisites
|
||||||
|
|
||||||
> **Production note:** Dankclaw's primary service now runs vLLM-ROCm with the Ling-3.0-flash CIRU INT4 model (see `scripts/frank-dragoon.service`). This page documents the alternative vLLM FP8 deployment of Qwen3.6-27B.
|
> **Era note (2026-08, superseded twice):** at writing time Dankclaw's primary
|
||||||
|
> service was the vLLM-ROCm Ling-3.0-flash CIRU INT4 trial ([[ling-3.0-flash-trial]],
|
||||||
|
> retired 2026-08-17), and this page documented the alternative vLLM FP8 deployment
|
||||||
|
> of Qwen3.6-27B. Both paths are dead; `scripts/frank-dragoon.service` today is the
|
||||||
|
> halogen flash-server unit ([[frank-dragoon]]).
|
||||||
|
|
||||||
Install vLLM for ROCm. Version 0.24.0+ is required for Qwen3.6 with speculative decoding:
|
Install vLLM for ROCm. Version 0.24.0+ is required for Qwen3.6 with speculative decoding:
|
||||||
|
|
||||||
|
|||||||
@@ -14,14 +14,10 @@ The pipeline-parallel split and the FastFlowLM NPU endpoint were retired.
|
|||||||
The old scripts moved to `old/scripts/` in this repository.
|
The old scripts moved to `old/scripts/` in this repository.
|
||||||
|
|
||||||
> **HISTORY — the topology below is two fleet generations dead.** Today the
|
> **HISTORY — the topology below is two fleet generations dead.** Today the
|
||||||
> fleet is three endpoints: [[frank-archon]]
|
> fleet is three endpoints, each owned by its page: [[frank-archon]]
|
||||||
> (`192.168.0.235:7770`, radiance 1.0.13, 2×R9700 TP=2),
|
> (`192.168.0.235:7770`), [[frank-dragoon]] (`192.168.0.143:7770`) and
|
||||||
> [[frank-dragoon]] (`192.168.0.143:7770`, halogen
|
> [[frank-zealot]] (`192.168.0.143:7771`). No vLLM and no ROCm endpoint serves
|
||||||
> flash-server 0.16.2 on the iGPU) and
|
> anything; there is no pipeline parallelism and no NPU endpoint.
|
||||||
> [[frank-zealot]] (`192.168.0.143:7771`, llama.cpp
|
|
||||||
> PrismML fork build 10754 on the RTX 3090 — the card that sat in Dankserver
|
|
||||||
> until 2026-09-15). No vLLM and no ROCm endpoint serves anything; there is no
|
|
||||||
> pipeline parallelism and no NPU endpoint.
|
|
||||||
|
|
||||||
## New Topology
|
## New Topology
|
||||||
|
|
||||||
|
|||||||
@@ -15,6 +15,8 @@ This page was the plan for a vLLM-ROCm deployment of
|
|||||||
Dankclaw. The deployment never shipped. The actual Ling work used the
|
Dankclaw. The deployment never shipped. The actual Ling work used the
|
||||||
llama.cpp Q6_K fork trial instead: [[ling-3.0-flash-trial]].
|
llama.cpp Q6_K fork trial instead: [[ling-3.0-flash-trial]].
|
||||||
|
|
||||||
The trial service (`frank-dragoon-ling`) is retired and disabled under the
|
The trial service (`frank-dragoon-ling`) was retired and disabled under the boot
|
||||||
boot policy (2026-08-17). `frank-dragoon` is the Qwen3.8-27B PP
|
policy on 2026-08-17, in the same redo that renamed `frank-dragoon` to the
|
||||||
head, not the Ling path. See git history for the full decision table.
|
Qwen3.8-27B PP head ([[frank-redo-2026-08-17]]). Two fleet generations later the
|
||||||
|
name belongs to the halogen flash-server endpoint ([[frank-dragoon]]). See git
|
||||||
|
history for the full decision table.
|
||||||
Reference in new issue
Block a user