Frank 4c5a4a5f3b docs: frank-default-small — 4 parallel slots, batch 8192/2048, n-cpu-moe 32 ...

Update Dankserver System Specs and deployment to reflect the 4-stream config:
- 4 parallel slots (800000 total ctx), batch 8192 / ubatch 2048
- n-cpu-moe 32 (8 expert layers back on GPU)
- ~870 MiB VRAM headroom under 4-stream load
- Knob documented: n-cpu-moe 36 gives ~1.7 GiB more headroom if needed

2026-08-11 03:13:36 -07:00

..

Dankclaw System Specs.md

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

2026-08-10 23:37:27 -07:00

Dankserver System Specs.md

docs: frank-default-small — 4 parallel slots, batch 8192/2048, n-cpu-moe 32

2026-08-11 03:13:36 -07:00

deployment.md

docs: frank-default-small — 4 parallel slots, batch 8192/2048, n-cpu-moe 32

2026-08-11 03:13:36 -07:00

DFlash DSpark Speculative Decoding.md

docs: frank-default-small now uses ngram-mod, DFlash retired

2026-08-11 02:41:33 -07:00

Hybrid CPU GPU Processing Dankserver.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

index.md

docs+deploy: Dankserver now llama.cpp frank-default-small (HauhauCS Q6_K_P + DFlash)

2026-08-11 01:18:29 -07:00

ling-3.0-flash-vllm-plan.md

docs: add Ling-3.0-flash vLLM-ROCm deployment plan (grilled decisions, port 7770)

2026-08-10 22:02:28 -07:00

Quantization by Hardware Architecture.md

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

2026-08-10 23:37:27 -07:00

RAM CPU Offloading in VLLM.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

2026-08-10 23:37:27 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

docs+deploy: Dankserver now llama.cpp frank-default-small (HauhauCS Q6_K_P + DFlash)

2026-08-11 01:18:29 -07:00

Shared Memory Architecture Dankclaw.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

VLLM Index.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

VLLM Overview.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

vllm_research_findings.md

feat: initial vLLM Qwen3.6-35B-A3B-FP8 serve script with DFlash drafting on dankserver

2026-08-07 18:28:38 -07:00