Frank 11f37dafd8 frank-default-large: split 0.68,0.32 = 45 blocks on 3090 (Q6_K phase 2) ...

Max for the Q6_K + q8_0/f16 KV config: 45 blocks (0-44), 11 FA layers
(3..43), KV 8624 MiB, ~0.7 GiB free. 46 layers -> ~0.4 GiB margin; 48
layers (f>=0.7197) adds FA block 47 -> KV 9408 -> OOM by ~0.85 GiB.
Draft model measured on ROCm0 only (no worker impact). Phase 1 (0.53)
verified: acceptance 0.833, KV 6272/6272, flash_attn auto, healthy.

2026-08-17 02:05:04 -07:00

..

analyze-spec-matrix.py

docs: Qwen3.8 spec-matrix benchmark page; add matrix tools; final env n_max=5

2026-08-14 14:28:51 -07:00

bench-frank-large.sh

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

bench-high-ctx.sh

dankclaw: switch backend to Vulkan0 (48% faster decode at 262k ctx); add bench-high-ctx.sh

2026-08-15 17:03:01 -07:00

bench-pipeline-64k.sh

bench: 4k pipeline harness w/ early crash check; parametrized spec-type

2026-08-11 16:14:44 -07:00

deploy.sh

deploy.sh: per-target health wait; 20 min for Dankclaw cold loads

2026-08-13 21:01:01 -07:00

frank-default-large.env

frank-default-large: split 0.68,0.32 = 45 blocks on 3090 (Q6_K phase 2)

2026-08-17 02:05:04 -07:00

frank-default-large.ling.env

ling B-test: spec off (--spec-type none), keep parallel=2 - isolate spec path as freeze trigger

2026-08-14 03:39:15 -07:00

frank-default-large.service

rename frank-pp-head to frank-default-large: PP split is the new production large endpoint (2026-08-16)

2026-08-16 13:44:31 -07:00

frank-default-small.env

frank-default-small: NPU model swap qwen3.6-moe:35b-a3b -> qwythos:9b (Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated)

2026-08-17 01:22:32 -07:00

frank-default-small.service

promote NPU endpoint to frank-default-small: FLM serve unit + wrapper + env (gemma4-it:e4b default), LimitMEMLOCK=infinity (2026-08-16)

2026-08-16 14:19:37 -07:00

frank-large-ling.service

dankclaw: Ling-3.0-flash Q6_K trial config (Vulkan+GTT+draft-mtp)

2026-08-14 01:20:30 -07:00

frank-pp-worker.env

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

frank-pp-worker.service

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

llama-server.service

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

pp-bench.py

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

pp-test.sh

pp-test: restore drops caches before production load; all-mode EXIT trap auto-restores; ssh ConnectTimeout

2026-08-16 10:17:01 -07:00

prune-rpc-cache.sh

docs + guard: single 262k slot state, split-limits analysis, cache incident

2026-08-17 01:24:06 -07:00

serve-flm-small.sh

frank-default-small: pmode turbo, ASR (Whisper-V3-Turbo) on, ctx-len 131072 (max verified)

2026-08-16 14:37:32 -07:00

serve-ling3-vllm.sh

feat: raise Ling-3 GPU memory utilization to 0.95

2026-08-10 23:25:02 -07:00

serve-ling-flash.sh

ling: batch 8192 (ubatch 3072); add -lv verbosity + log file for stop-investigation

2026-08-14 02:12:35 -07:00

serve-llama-frank-large.sh

dankclaw: add MTP=1 toggle - prepend draft-mtp before --spec-default ngram-mod fallback

2026-08-15 22:31:29 -07:00

serve-llama-frank-small.sh

frank-default-small: KV K+V to f16, add verbosity tunable (F16 KV diag)

2026-08-14 12:50:59 -07:00

serve-pp-head.sh

rename frank-pp-head to frank-default-large: PP split is the new production large endpoint (2026-08-16)

2026-08-16 13:44:31 -07:00

serve-pp-worker.sh

PP kit + Strix research: Qwen3.8-27B RPC split (Dankclaw head / Dankserver worker)

2026-08-16 05:40:27 -07:00

serve-vllm-qwen36-dflash.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

spec-matrix-bench.sh

docs: Qwen3.8 spec-matrix benchmark page; add matrix tools; final env n_max=5

2026-08-14 14:28:51 -07:00

test_dspark_stream.py

dankclaw: add accurate DSpark stream/queue test (PARALLEL=1) - reports true prompt_tokens; single+concurrent 16k pass

2026-08-15 14:32:21 -07:00

validate-vllm.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00