dank/serverAppConfigs
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
57264f7faa7f5c898140f49d34b78bf57f348b12
serverAppConfigs/scripts
T
History
Frank 57264f7faa record performance fixes: FA_ALL_QUANTS build flag (dankserver), RDNA triton FA env (dankclaw) 
- frank-default-large: GGML_CUDA_FA_ALL_QUANTS=ON is mandatory in the
  FastMTP build; without it q8_0 KV + FA falls back to a slow path and
  prefill collapses ~12x (95 -> 1312 t/s at 8K, measured)
- frank-default-small: FLASH_ATTENTION_TRITON_AMD_ENABLE=TRUE + pure-python
  flash_attn (triton_amd) + stub; without it the vision encoder warmup
  OOMs via torch SDPA
2026-08-17 16:30:22 -07:00
..
deploy.sh
fix: make serve scripts + deploy.sh executable
2026-08-17 15:24:40 -07:00
frank-default-large.env
record performance fixes: FA_ALL_QUANTS build flag (dankserver), RDNA triton FA env (dankclaw)
2026-08-17 16:30:22 -07:00
frank-default-large.service
fleet redo 2026-08-17: retire PP+NPU, new topology
2026-08-17 15:23:46 -07:00
frank-default-small.env
record performance fixes: FA_ALL_QUANTS build flag (dankserver), RDNA triton FA env (dankclaw)
2026-08-17 16:30:22 -07:00
frank-default-small.service
fleet redo 2026-08-17: retire PP+NPU, new topology
2026-08-17 15:23:46 -07:00
serve-frank-large.sh
fix: make serve scripts + deploy.sh executable
2026-08-17 15:24:40 -07:00
serve-frank-small.sh
fix: make serve scripts + deploy.sh executable
2026-08-17 15:24:40 -07:00