Frank fc75ca6ed8 frank-default-large: add MTP draft head (EasiiX Q8_0, draft-mtp+ngram-mod) ...

Add speculative decoding via EasiiX/Qwen3.8-Flash-Next-MTP-Strix-Halo-GGUF
Q8_0 sidecar (4.1 GB, qwen4exp architecture matching the main model).

- serve-frank-large.sh: SPEC_ARGS array, draft model existence check,
  spec defaults (n_max 4, p_min 0.75, ngl 999, ROCm0)
- frank-default-large.env: MTP tunables section, fix 'no MTP' comment
- kingjones-strix-rocmfp4.md: MTP Draft Head section, spec flags in
  serving profile, EasiiX + PR #27739 citations

Set SPEC_TYPE=none in the env to disable speculative decoding.

2026-08-27 23:52:42 -07:00

..

bench-ubatch.sh

Set equal batch and ubatch at 8k context

2026-08-25 21:04:00 -07:00

chat-template.jinja

Swap LLM fleet to Ornith CRACK (small) and kingjones ROCmFP4 STRIX MTP (large); apply Qwen-Sharp chat template

2026-08-24 21:35:11 -07:00

deploy-open-webui-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-pihole-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-plan.py

hermes-webui: add Hermex server as loopback compose service on Dankclaw

2026-08-26 08:17:27 -07:00

deploy-remote.sh

caddy: drop the systemctl enable; the quadlet generator already enables it

2026-08-26 20:19:03 -07:00

deploy-searxng-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy.sh

deploy.sh: accept hermes-webui in the top-level service inventory

2026-08-26 08:22:23 -07:00

download-q8agent.sh

Upgrade frank-default-large to kingjones Q8_0 AGENT at full 262144 context

2026-08-25 07:12:02 -07:00

frank-default-large.env

frank-default-large: add MTP draft head (EasiiX Q8_0, draft-mtp+ngram-mod)

2026-08-27 23:52:42 -07:00

frank-default-large.service

feat: swap both LLM services + remove config-assertion tests

2026-08-26 20:37:46 -07:00

frank-default-npu.env

Reorganize: llm/scripts -> scripts (LLM serve scripts, units, env tunables)

2026-08-22 15:07:31 -07:00

frank-default-npu.service

scripts: unified deploy.sh; units + bench point at the merged checkout

2026-08-22 15:50:39 -07:00

frank-default-small.env

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

frank-default-small.service

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

homepage-status.py

Homepage (TDD slice 7): fix the /admin/ path + status.json perms

2026-08-23 16:49:33 -07:00

homepage-status.service

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

homepage-status.timer

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

mount-entropy.sh

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

serve-frank-default-npu.sh

Reorganize: llm/scripts -> scripts (LLM serve scripts, units, env tunables)

2026-08-22 15:07:31 -07:00

serve-frank-large.sh

frank-default-large: add MTP draft head (EasiiX Q8_0, draft-mtp+ngram-mod)

2026-08-27 23:52:42 -07:00

serve-frank-small.sh

feat: replace llama.cpp Tiel-Coder with FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8

2026-08-27 02:01:16 -07:00

test-changed.sh

feat: swap both LLM services + remove config-assertion tests

2026-08-26 20:37:46 -07:00

tmux-resurrect.sh

feat: add tmux session snapshot and restore utility

2026-08-25 17:04:15 -07:00