docs(vault): era-correct the vLLM/Ling era pages (cluster C3)
- `Running Qwen3.6 27B FP8 on Dankclaw`: had no banner at all and opened as a live how-to. Added the RETIRED banner (iGPU endpoint today is [[frank-dragoon]]), era-tagged the hardware table, and rewrote the "primary service now runs vLLM-ROCm with Ling CIRU INT4" production note, which was false by three fleet generations. - `ling-3.0-flash-vllm-plan`: "frank-dragoon is the Qwen3.8-27B PP head" -> past tense with the 2026-08-17 redo as the anchor and the live owner named. - `frank-redo-2026-08-17` banner: stripped restated live shapes that had already drifted (radiance 1.0.13, PrismML b10754 - the fleet runs 10777) and the 3090-provenance clause owned by the PP deployment page; banner is now locator-only (names + ports + links). Verified before cutting: 457.9 t/s and the ping-RTT figures are solo-held by Ethernet Bandwidth Math.md (no duplicate), so both scout-reported "duplicates" were kept. Refs: vault de-dup campaign, cluster C3.
This commit is contained in:
1 parent
e32df1b04f
commit
73fb27254e
3 files changed
+21
-12
No files matched your search
@@ -7,6 +7,12 @@ timestamp: 2026-09-03
|
||||
---
|
||||
|
||||
# Running Qwen3.6 27B FP8 on Dankclaw
|
||||
> **RETIRED - vLLM era (before the 2026-08-17 redo).** Nothing on this page serves
|
||||
> today: no vLLM or ROCm process runs on Dankclaw, and the iGPU endpoint at
|
||||
> `192.168.0.143:7770` is [[frank-dragoon]] (halogen flash-server). The page stays as
|
||||
> the era record of the Qwen3.6-27B-FP8 vLLM bring-up and the Strix Halo ROCm
|
||||
> recipes ([[frank-redo-2026-08-17]]). The hardware table below carries the era's
|
||||
> host figures; live ones are [[Dankclaw System Specs]].
|
||||
|
||||
## Model Information
|
||||
|
||||
@@ -29,6 +35,7 @@ Qwen3.6-27B is a dense vision-language model from the Qwen3.6 series. It uses 27
|
||||
| Vision Encoder | Yes (image-text-to-text) |
|
||||
|
||||
## Hardware: Dankclaw
|
||||
*Era figures (2026-08). The host has changed since - [[Dankclaw System Specs]].*
|
||||
|
||||
| Property | Value |
|
||||
|----------|-------|
|
||||
@@ -55,7 +62,11 @@ The FP8 variant requires approximately 16-17 GB. ThinkingCap-FP8 requires ~29 GB
|
||||
|
||||
## Prerequisites
|
||||
|
||||
> **Production note:** Dankclaw's primary service now runs vLLM-ROCm with the Ling-3.0-flash CIRU INT4 model (see `scripts/frank-dragoon.service`). This page documents the alternative vLLM FP8 deployment of Qwen3.6-27B.
|
||||
> **Era note (2026-08, superseded twice):** at writing time Dankclaw's primary
|
||||
> service was the vLLM-ROCm Ling-3.0-flash CIRU INT4 trial ([[ling-3.0-flash-trial]],
|
||||
> retired 2026-08-17), and this page documented the alternative vLLM FP8 deployment
|
||||
> of Qwen3.6-27B. Both paths are dead; `scripts/frank-dragoon.service` today is the
|
||||
> halogen flash-server unit ([[frank-dragoon]]).
|
||||
|
||||
Install vLLM for ROCm. Version 0.24.0+ is required for Qwen3.6 with speculative decoding:
|
||||
|
||||
|
||||
Reference in new issue
Block a user