docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw
Update target maps (AGENTS, README, deployment, deploy.sh) from the retired ROCmFPX llama.cpp stack to the active vLLM-ROCm CIRU INT4 service on port 7770 with MTP speculative decoding. Align Dankserver to the running vllm-awq-qwen36 (AWQ, port 34401). Refresh KB pages: Dankclaw system specs (gpu-mem-util 0.95, CIRU venv), quantization choices (INT4 primary, MXFP4 experiment), DFlash/DSpark Dankclaw section, and the KB index topology.
This commit is contained in:
1 parent
52ad985978
commit
903d54c389
9 files changed
+55
-54
No files matched your search
+10
-6
@@ -8,20 +8,24 @@ Documentation for running vLLM inference on two local machines.
|
||||
graph LR
|
||||
subgraph Dankserver[NVIDIA Dankserver - Ubuntu 24.04]
|
||||
A[RTX 3090 24GB + 62GB RAM]
|
||||
B[vLLM 0.26.0 in Podman\nvllm-qwen36-dflash]
|
||||
C[Qwen3.6-35B-A3B-FP8\n+ DFlash draft, port 8000]
|
||||
B[vLLM in Podman
|
||||
vllm-awq-qwen36]
|
||||
C[Qwen3.6-35B-A3B AWQ 4bit
|
||||
port 34401]
|
||||
A --> B --> C
|
||||
end
|
||||
|
||||
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
|
||||
D[gfx1151 APU 30GiB phys / 96GiB GPU-visible]
|
||||
E[ROCmFPX llama.cpp\n/ROCmFPX/build-strix-rocmfp4]
|
||||
F[Ling-3.0-flash ROCmFP4-MTP\ndraft-mtp, port 8080]
|
||||
E[vLLM-ROCm CIRU INT4
|
||||
frank-default-large]
|
||||
F[Ling-3.0-flash CIRU INT4 MTP
|
||||
port 7770]
|
||||
D --> E --> F
|
||||
end
|
||||
|
||||
G[LLM Clients / API] -->|HTTP :8000| B
|
||||
G -->|HTTP :8080| E
|
||||
G[LLM Clients / API] -->|HTTP :34401| B
|
||||
G -->|HTTP :7770| E
|
||||
```
|
||||
|
||||
## Servers
|
||||
|
||||
Reference in new issue
Block a user