Frank 317610a540 perf: raise frank-default-large to batch 8192 / ubatch 2048 ...

Empirically verified on 2026-08-13 (caches dropped): batch 8192 / ubatch
2048 loads and serves at ctx 602100 with 61 GiB VRAM peak. The benchmark
doc's 'ubatch 2048 OOMs' results were confounded by page-cache pressure -
with the model's pages fully cached the KV/graph allocation stalls at
28 GiB VRAM. Drop caches (sync; echo 3 > /proc/sys/vm/drop_caches) before
starting a load to make restarts reliable.

2026-08-13 18:56:12 -07:00

..

bench-frank-large.sh

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

bench-pipeline-64k.sh

bench: 4k pipeline harness w/ early crash check; parametrized spec-type

2026-08-11 16:14:44 -07:00

deploy.sh

docs+deploy: Dankserver now llama.cpp frank-default-small (HauhauCS Q6_K_P + DFlash)

2026-08-11 01:18:29 -07:00

frank-default-large.env

perf: raise frank-default-large to batch 8192 / ubatch 2048

2026-08-13 18:56:12 -07:00

frank-default-large.service

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

frank-default-small.env

fix: rename sampling TEMP var to TEMPERATURE to avoid HIP runtime env collision

2026-08-13 17:54:29 -07:00

frank-default-small.service

feat: frank-default-small = HauhauCS Qwen3.6-35B-A3B uncensored Q6_K_P + DFlash on dankserver

2026-08-11 00:57:04 -07:00

llama-server.service

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

serve-ling3-vllm.sh

feat: raise Ling-3 GPU memory utilization to 0.95

2026-08-10 23:25:02 -07:00

serve-llama-frank-large.sh

perf: raise frank-default-large to batch 8192 / ubatch 2048

2026-08-13 18:56:12 -07:00

serve-llama-frank-small.sh

fix: rename sampling TEMP var to TEMPERATURE to avoid HIP runtime env collision

2026-08-13 17:54:29 -07:00

serve-vllm-qwen36-dflash.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

validate-vllm.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00