dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: record Dankserver VRAM/RAM growth investigation (2026-08-14)

Browse Source
This commit is contained in:
Frank committed 2026-08-14 12:44:24 -07:00
1 parent 9d7643ec5d
commit bea52138d2
3 files changed
+133
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/index.md
+1
View File
@@ -53,6 +53,7 @@ MTP-ONLY draft, port 7770]
- [[Running Qwen3.6 27B FP8 on Dankclaw]] — Dense model (27B) on Strix Halo APU
- [[frank-default-large-benchmark]] — backend/spec benchmark; chose MTP sidecar (2026-08-14) over DFlash (parallel premature-EOS bug)
- [[frank-default-small-benchmark]] — ncmoe and batch/ubatch sweep that drove the Dankserver state
- [[dankserver-vram-growth]] — VRAM/RAM growth investigation behind the recurring cuBLAS crash on frank-default-small
- [[Dankclaw Improvements]] — researched enhancements: self-hosted agentic tools, runtime tuning, server/OS settings
## Speculative Decoding & Quantization