Frank 3f88b8e1ed docs + script defaults: Q6_K swap, q8_0/f16 KV, split 0.68, FA rebuild ...

- spec matrix + PP doc + deployment.md + AGENTS.md + index.md: current
  production = Uncensored Q6_K + standalone MTP draft, mismatched
  q8_0/f16 KV with FA retained (GGML_CUDA_FA_ALL_QUANTS rebuild at
  9b05354ec), split 0.68 (45 blocks), KV 8624/3920, 273 MiB free.
- PP doc: 'FA-all-quants rebuild' section (flag, cmake commands, both
  hosts) + new-model split-limits measurements; old Q8_K_XL limits
  marked superseded.
- serve-pp-head.sh defaults: MODEL_FILE -> Q6_K, CACHE_TYPE_V -> f16
  (env already correct; defaults now match production).

2026-08-17 02:08:08 -07:00

..

Pipeline Parallelism

docs + script defaults: Q6_K swap, q8_0/f16 KV, split 0.68, FA rebuild

2026-08-17 02:08:08 -07:00

Dankclaw Improvements.md

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

Dankclaw System Specs.md

docs: FastFlowLM NPU research — AMD NPU runtime, 50 TOPS Strix Halo fit analysis, verified install state, test runbook (2026-08-16)

2026-08-16 12:29:11 -07:00

Dankserver System Specs.md

docs: record dual-f16 KV refit on frank-default-small (2026-08-14)

2026-08-14 12:59:10 -07:00

dankserver-vram-growth.md

docs: record dual-f16 KV refit on frank-default-small (2026-08-14)

2026-08-14 12:59:10 -07:00

deployment.md

docs + script defaults: Q6_K swap, q8_0/f16 KV, split 0.68, FA rebuild

2026-08-17 02:08:08 -07:00

DFlash DSpark Speculative Decoding.md

docs: record --spec-default + Vulkan0 + PARALLEL=2 final state; 262k-ctx ROCm-vs-Vulkan bench

2026-08-15 17:13:18 -07:00

FastFlowLM NPU Inference.md

docs: NPU endpoint now serves qwythos:9b (2026-08-17 swap, FLM 1.0.1)

2026-08-17 01:24:43 -07:00

frank-default-large-benchmark.md

docs: record --spec-default + Vulkan0 + PARALLEL=2 final state; 262k-ctx ROCm-vs-Vulkan bench

2026-08-15 17:13:18 -07:00

frank-default-small-benchmark.md

docs: record dual-f16 KV refit on frank-default-small (2026-08-14)

2026-08-14 12:59:10 -07:00

Hybrid CPU GPU Processing Dankserver.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

index.md

docs + script defaults: Q6_K swap, q8_0/f16 KV, split 0.68, FA rebuild

2026-08-17 02:08:08 -07:00

ling-3.0-flash-trial.md

docs: record Ling freeze diagnosis - spec path deadlock, resolution spec-off parallel=2

2026-08-14 03:49:42 -07:00

ling-3.0-flash-vllm-plan.md

docs: add Ling-3.0-flash vLLM-ROCm deployment plan (grilled decisions, port 7770)

2026-08-10 22:02:28 -07:00

Quantization by Hardware Architecture.md

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

2026-08-10 23:37:27 -07:00

qwen3.8-spec-matrix.md

docs + script defaults: Q6_K swap, q8_0/f16 KV, split 0.68, FA rebuild

2026-08-17 02:08:08 -07:00

qwen3.8-strix-optimizations.md

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

RAM CPU Offloading in VLLM.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

2026-08-10 23:37:27 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

docs+deploy: Dankserver now llama.cpp frank-default-small (HauhauCS Q6_K_P + DFlash)

2026-08-11 01:18:29 -07:00

Shared Memory Architecture Dankclaw.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

VLLM Index.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

VLLM Overview.md

docs: polish pass — fix stale names, duplicates, branding, and README

2026-08-10 21:12:23 -07:00

vllm_research_findings.md

feat: initial vLLM Qwen3.6-35B-A3B-FP8 serve script with DFlash drafting on dankserver

2026-08-07 18:28:38 -07:00