FrankandClaude 7689092db8 frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2 ...

Replace the Kairic Edge ROCmFPX build with the unsloth b11030 stock
llama.cpp prebuilt (ROCm gfx1151) serving unsloth/Qwen3.8-27B-GGUF:
UD-Q8_K_XL (a 27B dense model, 31.5 GiB) with the z-lab DFlash2 Q4_K_M
drafter (depth 4) on the gfx1151 iGPU.

Serving shape: one 262,144-token conversation, q8_0 KV (the build lacks
fp8), text-only, greedy sampling, Qwen-Sharp v22.4.0 template.

- scripts/serve-frank-large.sh: stock llama.cpp + DFlash2 spec decode
- scripts/frank-large.env: new model/drafter/runtime, 262144 ctx / 1 slot
- scripts/download-frank-large.sh: per-file fetch, verify mode, idempotent
- scripts/frank-large.service: updated description
- scripts/deploy-remote.sh: updated pkill pattern + asset gates
- tests/frank_large_unit.bats: new model/runtime/spec assertions
- docs: new runbook (active), Kairic Edge runbook retired (rollback target)

Co-Authored-By: Claude <noreply@anthropic.com>

2026-09-21 21:50:36 -07:00

..

.AGENTTRASH

frank-medium: llama.cpp layer split across both R9700s, DFlash2 drafting

2026-09-16 14:59:23 -07:00

e2e

tests: gate the hermes vhost, and stop specs from silently not running

2026-09-16 07:33:38 -07:00

anubis.bats

anubis: fix image ref typo in deploy pull, health probe exec form, unit alias tag

2026-08-28 11:18:41 -07:00

authentik.bats

docs+units: fix every claim my own changes made false

2026-09-16 07:46:23 -07:00

caddy_quadlet.bats

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

caddyfile.bats

docs+units: fix every claim my own changes made false

2026-09-16 07:46:23 -07:00

changed_tests.bats

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

comfyui_rocm.bats

comfyui: bake qwen_image21 patch into image via startup wrapper

2026-09-21 19:55:00 -07:00

compose_validity.bats

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

dankserver_quadlet.bats

feat(calibre-server): Calibre Content Server as a boot-persistent Quadlet

2026-09-21 12:46:02 -07:00

deployment_flow.bats

deploy-remote: prune stale pending state for retired services

2026-09-17 23:32:02 -07:00

deployment_scoping.bats

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

docs_completeness.bats

docs: three dangling links, and a gate so they cannot accumulate

2026-09-16 07:43:33 -07:00

e2e_scaffold.bats

tests: gate the hermes vhost, and stop specs from silently not running

2026-09-16 07:33:38 -07:00

env_consistency.bats

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

frank_large_unit.bats

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

frank_medium_unit.bats

feat(frank-medium): cut to MXFP4 checkpoint with unquantized bf16 KV

2026-09-21 16:32:19 -07:00

frank_small_unit.bats

perf(frank-small): cap the CPU RAM cache at 2048 MiB

2026-09-21 14:57:32 -07:00

frankbook_quadlet.bats

arr fleet: FrankBook-Pro is the sole deployment, all egress VPN-gated

2026-09-04 12:54:28 -07:00

helpers.bash

tests: LLM unit integrity, sudo-password leak guard, deploy LLM coverage

2026-08-22 15:49:44 -07:00

hermes_webui.bats

hermes vhost: dial netavark's host address, not the LAN IP (fixes the 502)

2026-09-16 19:28:34 -07:00

homepage_caddy.bats

homepage: revalidate assets so deploys never serve stale CSS/JS

2026-09-21 14:12:38 -07:00

homepage_checker.bats

homepage: sectioned panels, WIP open/closed, current model facts, Tautulli card

2026-09-21 13:20:15 -07:00

homepage_config.bats

homepage: sectioned panels, WIP open/closed, current model facts, Tautulli card

2026-09-21 13:20:15 -07:00

homepage_deploy.bats

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

homepage_pages.bats

homepage: AI section to the bottom; model-only AI descriptions

2026-09-21 15:02:14 -07:00

llm_secrets.bats

tests: LLM unit integrity, sudo-password leak guard, deploy LLM coverage

2026-08-22 15:49:44 -07:00

llm_units.bats

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

marreta_quadlet.bats

marreta: content-cleaning proxy on Dankclaw, gluetun netns, guard-chained

2026-09-12 10:09:12 -07:00

mount_entropy.bats

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

observability_quadlet.bats

fix(monitoring): scrape node-dankclaw via host.containers.internal

2026-09-21 11:09:03 -07:00

open_webui_quadlet.bats

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

pihole.bats

pihole: also neutralize the /etc/sysctl.conf sysctl override

2026-08-26 20:08:30 -07:00

run.sh

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

scripts_syntax.bats

bench: commit the harnesses the frank-medium numbers came from

2026-09-16 06:59:44 -07:00

searxng_limiter.bats

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

searxng_quadlet.bats

SearXNG quadlet: use AddDevice= (the generator rejects Device=)

2026-08-19 00:00:42 -07:00

seerr_quadlet.bats

seerr: quadlet on dankclaw + guard-chain vhost + deployer wiring

2026-09-01 14:40:10 -07:00