Frank 4edcada2a8 Increase max-model-len to 32768, cpu-offload to 40GB, add reasoning-parser and tool-call-parser

2026-08-08 12:03:23 -07:00

..

llama-server.service

Bump context to 600000 (200000/stream x 3 parallel)

2026-08-07 17:18:10 -07:00

serve-llamacpp-dflash.sh

Bump context to 600000 (200000/stream x 3 parallel)

2026-08-07 17:18:10 -07:00

serve-vllm-qwen36-dflash.sh

feat: initial vLLM Qwen3.6-35B-A3B-FP8 serve script with DFlash drafting on dankserver

2026-08-07 18:28:38 -07:00

validate-vllm.sh

Increase max-model-len to 32768, cpu-offload to 40GB, add reasoning-parser and tool-call-parser

2026-08-08 12:03:23 -07:00

validate.sh

Use --alias frank-default-large, multi-stream validation script

2026-08-07 17:15:09 -07:00

vllm-qwen36.service

feat: initial vLLM Qwen3.6-35B-A3B-FP8 serve script with DFlash drafting on dankserver

2026-08-07 18:28:38 -07:00