Frank 209223cb4f Offload one more MoE expert to CPU on frank-default-small (34→35 of 40) ...

- N_CPU_MOE 34→35: 5 expert layers on GPU instead of 6. Frees ~0.4-0.8 GiB
  VRAM for OOM safety after high-load sessions OOM'd at 32 and 33.
- Sync stale doc references (deployment.md, Dankserver System Specs.md)
  that still claimed 32/8; specs now estimate ~1.8 GiB headroom at 35.

2026-08-13 20:18:20 -07:00

..

bench-frank-large.sh

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

bench-pipeline-64k.sh

bench: 4k pipeline harness w/ early crash check; parametrized spec-type

2026-08-11 16:14:44 -07:00

deploy.sh

deploy.sh: drop page caches before restart; headless sudo; ssh-based health check

2026-08-13 19:05:26 -07:00

frank-default-large.env

perf: raise frank-default-large to batch 8192 / ubatch 2048

2026-08-13 18:56:12 -07:00

frank-default-large.service

feat: frank-default-large → llama.cpp Qwen3.6-27B Q8_K_P + DFlash draft + ngram-mod (bench pending)

2026-08-11 13:47:37 -07:00

frank-default-small.env

Offload one more MoE expert to CPU on frank-default-small (34→35 of 40)

2026-08-13 20:18:20 -07:00

frank-default-small.service

feat: frank-default-small = HauhauCS Qwen3.6-35B-A3B uncensored Q6_K_P + DFlash on dankserver

2026-08-11 00:57:04 -07:00

llama-server.service

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

serve-ling3-vllm.sh

feat: raise Ling-3 GPU memory utilization to 0.95

2026-08-10 23:25:02 -07:00

serve-llama-frank-large.sh

perf: raise frank-default-large to batch 8192 / ubatch 2048

2026-08-13 18:56:12 -07:00

serve-llama-frank-small.sh

Offload one more MoE expert to CPU on frank-default-small (34→35 of 40)

2026-08-13 20:18:20 -07:00

serve-vllm-qwen36-dflash.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00

validate-vllm.sh

sync scripts from remotes: ROCmFPX llama-server.service (dankclaw), dankserver vLLM serve/validate; drop failed-attempt scripts

2026-08-10 19:48:46 -07:00