docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

Update target maps (AGENTS, README, deployment, deploy.sh) from the retired
ROCmFPX llama.cpp stack to the active vLLM-ROCm CIRU INT4 service on port 7770
with MTP speculative decoding. Align Dankserver to the running
vllm-awq-qwen36 (AWQ, port 34401). Refresh KB pages: Dankclaw system specs
(gpu-mem-util 0.95, CIRU venv), quantization choices (INT4 primary, MXFP4
experiment), DFlash/DSpark Dankclaw section, and the KB index topology.
This commit is contained in:
Frank committed 2026-08-10 23:37:27 -07:00
1 parent 52ad985978
commit 903d54c389
9 files changed
+55 -54

No files matched your search

+10 -6
View File
@@ -8,20 +8,24 @@ Documentation for running vLLM inference on two local machines.
graph LR
subgraph Dankserver[NVIDIA Dankserver - Ubuntu 24.04]
A[RTX 3090 24GB + 62GB RAM]
B[vLLM 0.26.0 in Podman\nvllm-qwen36-dflash]
C[Qwen3.6-35B-A3B-FP8\n+ DFlash draft, port 8000]
B[vLLM in Podman
vllm-awq-qwen36]
C[Qwen3.6-35B-A3B AWQ 4bit
port 34401]
A --> B --> C
end
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
D[gfx1151 APU 30GiB phys / 96GiB GPU-visible]
E[ROCmFPX llama.cpp\n/ROCmFPX/build-strix-rocmfp4]
F[Ling-3.0-flash ROCmFP4-MTP\ndraft-mtp, port 8080]
E[vLLM-ROCm CIRU INT4
frank-default-large]
F[Ling-3.0-flash CIRU INT4 MTP
port 7770]
D --> E --> F
end
G[LLM Clients / API] -->|HTTP :8000| B
G -->|HTTP :8080| E
G[LLM Clients / API] -->|HTTP :34401| B
G -->|HTTP :7770| E
```
## Servers