Frank 0ff35e6620 bench: spec decode sweep + fix serve script ngram-only path ...

serve-frank-large.sh: only pass --model-draft when SPEC_TYPE contains
'draft-mtp'. ngram-only configs (ngram-mod, ngram-simple, etc.) do not
need a draft model file — loading one wastes VRAM and may error.

bench-spec-decode.py: new benchmark script. Sweeps 4 configs (none,
ngram-mod, draft-mtp, draft-mtp+ngram-mod), generates 16k tokens per
config at temp 0 from a minimal prompt. Uses HTTP API (llama-bench
cannot target --spec-type). Follows benchmarking policy: stop+mask
the production service, bench, unmask+restart, health check.

2026-08-28 00:04:21 -07:00

..

bench-spec-decode.py

bench: spec decode sweep + fix serve script ngram-only path

2026-08-28 00:04:21 -07:00

bench-ubatch.sh

Set equal batch and ubatch at 8k context

2026-08-25 21:04:00 -07:00

chat-template.jinja

Swap LLM fleet to Ornith CRACK (small) and kingjones ROCmFP4 STRIX MTP (large); apply Qwen-Sharp chat template

2026-08-24 21:35:11 -07:00

deploy-open-webui-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-pihole-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-plan.py

hermes-webui: add Hermex server as loopback compose service on Dankclaw

2026-08-26 08:17:27 -07:00

deploy-remote.sh

caddy: drop the systemctl enable; the quadlet generator already enables it

2026-08-26 20:19:03 -07:00

deploy-searxng-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy.sh

deploy.sh: accept hermes-webui in the top-level service inventory

2026-08-26 08:22:23 -07:00

download-q8agent.sh

Upgrade frank-default-large to kingjones Q8_0 AGENT at full 262144 context

2026-08-25 07:12:02 -07:00

frank-default-large.env

frank-default-large: add MTP draft head (EasiiX Q8_0, draft-mtp+ngram-mod)

2026-08-27 23:52:42 -07:00

frank-default-large.service

feat: swap both LLM services + remove config-assertion tests

2026-08-26 20:37:46 -07:00

frank-default-npu.env

Reorganize: llm/scripts -> scripts (LLM serve scripts, units, env tunables)

2026-08-22 15:07:31 -07:00

frank-default-npu.service

scripts: unified deploy.sh; units + bench point at the merged checkout

2026-08-22 15:50:39 -07:00

frank-default-small.env

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

frank-default-small.service

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

homepage-status.py

Homepage (TDD slice 7): fix the /admin/ path + status.json perms

2026-08-23 16:49:33 -07:00

homepage-status.service

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

homepage-status.timer

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

mount-entropy.sh

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

serve-frank-default-npu.sh

Reorganize: llm/scripts -> scripts (LLM serve scripts, units, env tunables)

2026-08-22 15:07:31 -07:00

serve-frank-large.sh

bench: spec decode sweep + fix serve script ngram-only path

2026-08-28 00:04:21 -07:00

serve-frank-small.sh

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

test-changed.sh

feat: swap both LLM services + remove config-assertion tests

2026-08-26 20:37:46 -07:00

tmux-resurrect.sh

feat: add tmux session snapshot and restore utility

2026-08-25 17:04:15 -07:00