dank/serverAppConfigs
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
e45f457ad498b47d220effebfac04e5006bb391e
serverAppConfigs/scripts
T
History
Frank e45f457ad4 perf: frank-default-small batch 3072 / ubatch 1536 + ctx-checkpoints 
Bigger logical/physical batches for prefill throughput. Enable
--ctx-checkpoints to park attention checkpoints in RAM, holding peak GPU
memory down so the larger ubatch fits the 24GB VRAM alongside 3x262144 KV
without OOM. Weight split unchanged (experts CPU, non-experts GPU).
2026-08-11 01:33:28 -07:00
..
deploy.sh
docs+deploy: Dankserver now llama.cpp frank-default-small (HauhauCS Q6_K_P + DFlash)
2026-08-11 01:18:29 -07:00
frank-default-large.service
feat: add Ling-3.0-flash vLLM service for Dankclaw (frank-default-large, port 7770)
2026-08-10 22:36:37 -07:00
frank-default-small.env
perf: frank-default-small batch 3072 / ubatch 1536 + ctx-checkpoints
2026-08-11 01:33:28 -07:00
frank-default-small.service
feat: frank-default-small = HauhauCS Qwen3.6-35B-A3B uncensored Q6_K_P + DFlash on dankserver
2026-08-11 00:57:04 -07:00
llama-server.service
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00
serve-ling3-vllm.sh
feat: raise Ling-3 GPU memory utilization to 0.95
2026-08-10 23:25:02 -07:00
serve-llama-frank-small.sh
perf: frank-default-small batch 3072 / ubatch 1536 + ctx-checkpoints
2026-08-11 01:33:28 -07:00
serve-vllm-qwen36-dflash.sh
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00
validate-vllm.sh
sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts
2026-08-10 19:48:46 -07:00