Frank 1cebbf47f6 frank-default-small: swap to nameistoken Quark W8A8 INT8, batch 8192 ...

- Model: nameistoken/Qwen3.6-35B-A3B-Quark-W8A8-INT8 (AMD Quark W8A8,
  vLLM-native expert layout). The Avesed quant emitted malformed Qwen3
  XML tool calls; the Quark model follows the format cleanly.
- max-num-batched-tokens lowered 16384 -> 8192 (user request).
- Chat template: neutral path qwen36-chat_template-tools.jinja (same
  base template; adds a concrete worked tool-call example).

2026-08-17 17:49:27 -07:00

..

deploy.sh

fix: make serve scripts + deploy.sh executable

2026-08-17 15:24:40 -07:00

frank-default-large.env

record performance fixes: FA_ALL_QUANTS build flag (dankserver), RDNA triton FA env (dankclaw)

2026-08-17 16:30:22 -07:00

frank-default-large.service

fleet redo 2026-08-17: retire PP+NPU, new topology

2026-08-17 15:23:46 -07:00

frank-default-small.env

frank-default-small: swap to nameistoken Quark W8A8 INT8, batch 8192

2026-08-17 17:49:27 -07:00

frank-default-small.service

fleet redo 2026-08-17: retire PP+NPU, new topology

2026-08-17 15:23:46 -07:00

serve-frank-large.sh

fix: make serve scripts + deploy.sh executable

2026-08-17 15:24:40 -07:00

serve-frank-small.sh

frank-default-small: swap to nameistoken Quark W8A8 INT8, batch 8192

2026-08-17 17:49:27 -07:00