dank/serverAppConfigs
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
0d09756430920a918e3df0c027a7822263c36f1f
serverAppConfigs/scripts
T
History
Frank 0d09756430 dankclaw: revert MTP+ngram layering (slower); ubatch 8192 
MTP+ngram benched 12.0-13.6 t/s (vs MTP alone 15.3-19.5) and is
parallel-safe, but slower - layering does not pay off. Back to MTP
alone. Test ubatch 8192 (== batch) using the VRAM headroom; watch for
OOM during load.
2026-08-13 22:46:55 -07:00
..
bench-frank-large.sh
feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)
2026-08-11 13:47:37 -07:00
bench-pipeline-64k.sh
bench: 4k pipeline harness w/ early crash check; parametrized spec-type
2026-08-11 16:14:44 -07:00
deploy.sh
deploy.sh: per-target health wait; 20 min for Dankclaw cold loads
2026-08-13 21:01:01 -07:00
frank-default-large.env
dankclaw: revert MTP+ngram layering (slower); ubatch 8192
2026-08-13 22:46:55 -07:00
frank-default-large.service
feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)
2026-08-11 13:47:37 -07:00
frank-default-small.env
Offload one more MoE expert to CPU on frank-default-small (34→35 of 40)
2026-08-13 20:18:20 -07:00
frank-default-small.service
feat: frank-default-small = HauhauCS Qwen3.6-35B-A3B uncensored Q6_K_P + DFlash on dankserver
2026-08-11 00:57:04 -07:00
llama-server.service
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00
serve-ling3-vllm.sh
feat: raise Ling-3 GPU memory utilization to 0.95
2026-08-10 23:25:02 -07:00
serve-llama-frank-large.sh
dankclaw: bench cycle 1 - switch spec to ngram-mod; draft flags conditional
2026-08-13 21:16:32 -07:00
serve-llama-frank-small.sh
Offload one more MoE expert to CPU on frank-default-small (34→35 of 40)
2026-08-13 20:18:20 -07:00
serve-vllm-qwen36-dflash.sh
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00
validate-vllm.sh
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00