From 73fb27254ed48045c1fb356b147abe943f1ffa8d Mon Sep 17 00:00:00 2001 From: Frank Date: Mon, 19 Oct 2026 01:59:13 -0700 Subject: [PATCH] docs(vault): era-correct the vLLM/Ling era pages (cluster C3) - `Running Qwen3.6 27B FP8 on Dankclaw`: had no banner at all and opened as a live how-to. Added the RETIRED banner (iGPU endpoint today is [[frank-dragoon]]), era-tagged the hardware table, and rewrote the "primary service now runs vLLM-ROCm with Ling CIRU INT4" production note, which was false by three fleet generations. - `ling-3.0-flash-vllm-plan`: "frank-dragoon is the Qwen3.8-27B PP head" -> past tense with the 2026-08-17 redo as the anchor and the live owner named. - `frank-redo-2026-08-17` banner: stripped restated live shapes that had already drifted (radiance 1.0.13, PrismML b10754 - the fleet runs 10777) and the 3090-provenance clause owned by the PP deployment page; banner is now locator-only (names + ports + links). Verified before cutting: 457.9 t/s and the ping-RTT figures are solo-held by Ethernet Bandwidth Math.md (no duplicate), so both scout-reported "duplicates" were kept. Refs: vault de-dup campaign, cluster C3. --- .../LLM/Running Qwen3.6 27B FP8 on Dankclaw.md | 13 ++++++++++++- serverAppConfigs-docs/LLM/frank-redo-2026-08-17.md | 12 ++++-------- .../LLM/ling-3.0-flash-vllm-plan.md | 8 +++++--- 3 files changed, 21 insertions(+), 12 deletions(-) diff --git a/serverAppConfigs-docs/LLM/Running Qwen3.6 27B FP8 on Dankclaw.md b/serverAppConfigs-docs/LLM/Running Qwen3.6 27B FP8 on Dankclaw.md index 69baf21..fb00bc0 100644 --- a/serverAppConfigs-docs/LLM/Running Qwen3.6 27B FP8 on Dankclaw.md +++ b/serverAppConfigs-docs/LLM/Running Qwen3.6 27B FP8 on Dankclaw.md @@ -7,6 +7,12 @@ timestamp: 2026-09-03 --- # Running Qwen3.6 27B FP8 on Dankclaw +> **RETIRED - vLLM era (before the 2026-08-17 redo).** Nothing on this page serves +> today: no vLLM or ROCm process runs on Dankclaw, and the iGPU endpoint at +> `192.168.0.143:7770` is [[frank-dragoon]] (halogen flash-server). The page stays as +> the era record of the Qwen3.6-27B-FP8 vLLM bring-up and the Strix Halo ROCm +> recipes ([[frank-redo-2026-08-17]]). The hardware table below carries the era's +> host figures; live ones are [[Dankclaw System Specs]]. ## Model Information @@ -29,6 +35,7 @@ Qwen3.6-27B is a dense vision-language model from the Qwen3.6 series. It uses 27 | Vision Encoder | Yes (image-text-to-text) | ## Hardware: Dankclaw +*Era figures (2026-08). The host has changed since - [[Dankclaw System Specs]].* | Property | Value | |----------|-------| @@ -55,7 +62,11 @@ The FP8 variant requires approximately 16-17 GB. ThinkingCap-FP8 requires ~29 GB ## Prerequisites -> **Production note:** Dankclaw's primary service now runs vLLM-ROCm with the Ling-3.0-flash CIRU INT4 model (see `scripts/frank-dragoon.service`). This page documents the alternative vLLM FP8 deployment of Qwen3.6-27B. +> **Era note (2026-08, superseded twice):** at writing time Dankclaw's primary +> service was the vLLM-ROCm Ling-3.0-flash CIRU INT4 trial ([[ling-3.0-flash-trial]], +> retired 2026-08-17), and this page documented the alternative vLLM FP8 deployment +> of Qwen3.6-27B. Both paths are dead; `scripts/frank-dragoon.service` today is the +> halogen flash-server unit ([[frank-dragoon]]). Install vLLM for ROCm. Version 0.24.0+ is required for Qwen3.6 with speculative decoding: diff --git a/serverAppConfigs-docs/LLM/frank-redo-2026-08-17.md b/serverAppConfigs-docs/LLM/frank-redo-2026-08-17.md index 106134f..687be05 100644 --- a/serverAppConfigs-docs/LLM/frank-redo-2026-08-17.md +++ b/serverAppConfigs-docs/LLM/frank-redo-2026-08-17.md @@ -14,14 +14,10 @@ The pipeline-parallel split and the FastFlowLM NPU endpoint were retired. The old scripts moved to `old/scripts/` in this repository. > **HISTORY — the topology below is two fleet generations dead.** Today the -> fleet is three endpoints: [[frank-archon]] -> (`192.168.0.235:7770`, radiance 1.0.13, 2×R9700 TP=2), -> [[frank-dragoon]] (`192.168.0.143:7770`, halogen -> flash-server 0.16.2 on the iGPU) and -> [[frank-zealot]] (`192.168.0.143:7771`, llama.cpp -> PrismML fork build 10754 on the RTX 3090 — the card that sat in Dankserver -> until 2026-09-15). No vLLM and no ROCm endpoint serves anything; there is no -> pipeline parallelism and no NPU endpoint. +> fleet is three endpoints, each owned by its page: [[frank-archon]] +> (`192.168.0.235:7770`), [[frank-dragoon]] (`192.168.0.143:7770`) and +> [[frank-zealot]] (`192.168.0.143:7771`). No vLLM and no ROCm endpoint serves +> anything; there is no pipeline parallelism and no NPU endpoint. ## New Topology diff --git a/serverAppConfigs-docs/LLM/ling-3.0-flash-vllm-plan.md b/serverAppConfigs-docs/LLM/ling-3.0-flash-vllm-plan.md index 6a79b10..53d8e0d 100644 --- a/serverAppConfigs-docs/LLM/ling-3.0-flash-vllm-plan.md +++ b/serverAppConfigs-docs/LLM/ling-3.0-flash-vllm-plan.md @@ -15,6 +15,8 @@ This page was the plan for a vLLM-ROCm deployment of Dankclaw. The deployment never shipped. The actual Ling work used the llama.cpp Q6_K fork trial instead: [[ling-3.0-flash-trial]]. -The trial service (`frank-dragoon-ling`) is retired and disabled under the -boot policy (2026-08-17). `frank-dragoon` is the Qwen3.8-27B PP -head, not the Ling path. See git history for the full decision table. +The trial service (`frank-dragoon-ling`) was retired and disabled under the boot +policy on 2026-08-17, in the same redo that renamed `frank-dragoon` to the +Qwen3.8-27B PP head ([[frank-redo-2026-08-17]]). Two fleet generations later the +name belongs to the halogen flash-server endpoint ([[frank-dragoon]]). See git +history for the full decision table.