docs: record --spec-default + Vulkan0 + PARALLEL=2 final state; 262k-ctx ROCm-vs-Vulkan bench

This commit is contained in:
Frank committed 2026-08-15 17:13:18 -07:00
1 parent 5296cf11d7
commit b6f2ee2945
6 files changed
+77 -44

No files matched your search

+3 -3
View File
@@ -17,10 +17,10 @@ MoE experts on CPU, port 7770]
subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
D[gfx1151 APU 30GiB phys / 96GiB GPU-visible]
E[llama.cpp DSpark sidecar draft
E[llama.cpp --spec-default ngram-mod
frank-default-large]
F[Qwen3.8-27B UD-Q8_K_XL
DSpark Q8_0 draft, port 7770, PARALLEL=1]
Vulkan0 backend, port 7770, PARALLEL=2]
D --> E --> F
end
@@ -52,7 +52,7 @@ DSpark Q8_0 draft, port 7770, PARALLEL=1]
- [[Running Qwen3.6 35B A3B FP8 on Dankserver]] — MoE model (35B total, 3B active) on RTX 3090
- [[Running Qwen3.6 27B FP8 on Dankclaw]] — Dense model (27B) on Strix Halo APU
- [[frank-default-large-benchmark]] — backend/spec benchmark; chose MTP sidecar (2026-08-14) over DFlash (parallel premature-EOS bug)
- [[qwen3.8-spec-matrix]] — Qwen3.8-27B UD-Q8_K_XL spec matrix; production = DSpark sidecar draft, PARALLEL=1 (2026-08-15 DSpark ROCm parallel crash)
- [[qwen3.8-spec-matrix]] — Qwen3.8-27B UD-Q8_K_XL spec matrix; production = --spec-default (ngram-mod), PARALLEL=2, Vulkan0 backend (2026-08-15)
- [[frank-default-small-benchmark]] — ncmoe and batch/ubatch sweep that drove the Dankserver state
- [[dankserver-vram-growth]] — VRAM/RAM growth investigation behind the recurring cuBLAS crash on frank-default-small
- [[Dankclaw Improvements]] — researched enhancements: self-hosted agentic tools, runtime tuning, server/OS settings