docs: frank-default-large llama.cpp draft-dflash deployment + benchmark results; retire Ling vLLM references

This commit is contained in:
Frank
2026-08-11 17:24:59 -07:00
parent 668083fe76
commit e92c72fd11
4 changed files with 99 additions and 10 deletions
+4 -3
View File
@@ -17,10 +17,10 @@ experts on CPU, port 7770]
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
D[gfx1151 APU 30GiB phys / 96GiB GPU-visible]
E[vLLM-ROCm CIRU INT4
E[llama.cpp DFlash draft
frank-default-large]
F[Ling-3.0-flash CIRU INT4 MTP
port 7770]
F[Qwen3.6-27B uncensored Q8_K_P
DFlash draft, port 7770]
D --> E --> F
end
@@ -51,6 +51,7 @@ port 7770]
- [[Running Qwen3.6 35B A3B FP8 on Dankserver]] — MoE model (35B total, 3B active) on RTX 3090
- [[Running Qwen3.6 27B FP8 on Dankclaw]] — Dense model (27B) on Strix Halo APU
- [[frank-default-large-benchmark]] — backend/spec benchmark that drove the Dankclaw llama.cpp deployment
## Speculative Decoding & Quantization