Frank f70460b002 frank-default-small: KV K+V to f16, add verbosity tunable (F16 KV diag) ...

F16 K removes the flash-attn F16-conversion workspace (MMA_F16 prefill
kernel needs no copy when K is already f16). Trades static KV pool size
for the context-proportional workspace growth implicated in the
cublasSgemm_v2 crash class. VERBOSITY=4 run logs real allocation sizes;
refit CTX_SIZE if the pool does not fit on the 24 GiB 3090.

2026-08-14 12:50:59 -07:00

..

bench-frank-large.sh

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

bench-pipeline-64k.sh

bench: 4k pipeline harness w/ early crash check; parametrized spec-type

2026-08-11 16:14:44 -07:00

deploy.sh

deploy.sh: per-target health wait; 20 min for Dankclaw cold loads

2026-08-13 21:01:01 -07:00

frank-default-large.env

dankclaw: FINAL spec - draft-mtp n_max 3, ubatch 8192

2026-08-13 23:07:38 -07:00

frank-default-large.ling.env

ling B-test: spec off (--spec-type none), keep parallel=2 - isolate spec path as freeze trigger

2026-08-14 03:39:15 -07:00

frank-default-large.service

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

frank-default-small.env

frank-default-small: KV K+V to f16, add verbosity tunable (F16 KV diag)

2026-08-14 12:50:59 -07:00

frank-default-small.service

feat: frank-default-small = HauhauCS Qwen3.6-35B-A3B uncensored Q6_K_P + DFlash on dankserver

2026-08-11 00:57:04 -07:00

frank-large-ling.service

dankclaw: Ling-3.0-flash Q6_K trial config (Vulkan+GTT+draft-mtp)

2026-08-14 01:20:30 -07:00

llama-server.service

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

serve-ling3-vllm.sh

feat: raise Ling-3 GPU memory utilization to 0.95

2026-08-10 23:25:02 -07:00

serve-ling-flash.sh

ling: batch 8192 (ubatch 3072); add -lv verbosity + log file for stop-investigation

2026-08-14 02:12:35 -07:00

serve-llama-frank-large.sh

dankclaw: bench cycle 1 - switch spec to ngram-mod; draft flags conditional

2026-08-13 21:16:32 -07:00

serve-llama-frank-small.sh

frank-default-small: KV K+V to f16, add verbosity tunable (F16 KV diag)

2026-08-14 12:50:59 -07:00

serve-vllm-qwen36-dflash.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

validate-vllm.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00