Frank 8d88b3a0a9 frank-small: int8 KV (per-token, per-head) — doubles the pool ...

fp8 KV is hardware-dead on the 3090 (sm_86, no cvt.e4m3x2), so int8 is
the cheapest quant the TRITON_ATTN backend can run: pure ALU dequant,
same backend, no fp8 tensor cores needed. 289,647 -> ~579k-token pool,
two -> four full-context sessions. Quality verified against the bf16
baseline (needle-in-haystack at 213k + short battery) before the swap.

2026-09-18 23:24:37 -07:00

..

.AGENTTRASH

frank-medium: llama.cpp layer split across both R9700s, DFlash2 drafting

2026-09-16 14:59:23 -07:00

e2e

tests: gate the hermes vhost, and stop specs from silently not running

2026-09-16 07:33:38 -07:00

anubis.bats

anubis: fix image ref typo in deploy pull, health probe exec form, unit alias tag

2026-08-28 11:18:41 -07:00

authentik.bats

docs+units: fix every claim my own changes made false

2026-09-16 07:46:23 -07:00

caddy_quadlet.bats

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

caddyfile.bats

docs+units: fix every claim my own changes made false

2026-09-16 07:46:23 -07:00

changed_tests.bats

frank-medium: llama.cpp layer split across both R9700s, DFlash2 drafting

2026-09-16 14:59:23 -07:00

comfyui_rocm.bats

docs+units: fix every claim my own changes made false

2026-09-16 07:46:23 -07:00

compose_validity.bats

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

dankserver_quadlet.bats

quadlet: drop the userns identity model — rootless cannot map uid 997

2026-09-01 22:46:00 -07:00

deployment_flow.bats

deploy-remote: prune stale pending state for retired services

2026-09-17 23:32:02 -07:00

deployment_scoping.bats

frank-small: llama.cpp -> vLLM (gemma-4-12B-it-qat-w4a16-ct, w4a16 Marlin)

2026-09-18 21:06:46 -07:00

docs_completeness.bats

docs: three dangling links, and a gate so they cannot accumulate

2026-09-16 07:43:33 -07:00

e2e_scaffold.bats

tests: gate the hermes vhost, and stop specs from silently not running

2026-09-16 07:33:38 -07:00

env_consistency.bats

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

frank_large_unit.bats

frank-small: llama.cpp -> vLLM (gemma-4-12B-it-qat-w4a16-ct, w4a16 Marlin)

2026-09-18 21:06:46 -07:00

frank_medium_unit.bats

frank-medium: double the host-RAM prompt cache to 16 GiB

2026-09-18 15:25:55 -07:00

frank_small_unit.bats

frank-small: int8 KV (per-token, per-head) — doubles the pool

2026-09-18 23:24:37 -07:00

frankbook_quadlet.bats

arr fleet: FrankBook-Pro is the sole deployment, all egress VPN-gated

2026-09-04 12:54:28 -07:00

helpers.bash

tests: LLM unit integrity, sudo-password leak guard, deploy LLM coverage

2026-08-22 15:49:44 -07:00

hermes_webui.bats

hermes vhost: dial netavark's host address, not the LAN IP (fixes the 502)

2026-09-16 19:28:34 -07:00

homepage_caddy.bats

caddy: www holds the homepage; naked domain redirects at the TLS edge

2026-08-29 15:11:18 -07:00

homepage_checker.bats

Homepage (TDD slice 7): fix the /admin/ path + status.json perms

2026-08-23 16:49:33 -07:00

homepage_config.bats

observability: the LLM surfaces follow the two-endpoint split

2026-09-16 13:59:49 -07:00

homepage_deploy.bats

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

homepage_pages.bats

homepage: live model info on the fleet cards, user docs page at /docs

2026-09-17 23:25:50 -07:00

llm_secrets.bats

tests: LLM unit integrity, sudo-password leak guard, deploy LLM coverage

2026-08-22 15:49:44 -07:00

llm_units.bats

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

marreta_quadlet.bats

marreta: content-cleaning proxy on Dankclaw, gluetun netns, guard-chained

2026-09-12 10:09:12 -07:00

mount_entropy.bats

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

observability_quadlet.bats

relay: address the account by phone number and pass the message via -m

2026-09-17 18:28:20 -07:00

open_webui_quadlet.bats

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

pihole.bats

pihole: also neutralize the /etc/sysctl.conf sysctl override

2026-08-26 20:08:30 -07:00

run.sh

feat: initialize serverAppConfigs with podman stacks for Dankserver and Dankclaw

2026-08-13 20:19:41 -07:00

scripts_syntax.bats

bench: commit the harnesses the frank-medium numbers came from

2026-09-16 06:59:44 -07:00

searxng_limiter.bats

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

searxng_quadlet.bats

SearXNG quadlet: use AddDevice= (the generator rejects Device=)

2026-08-19 00:00:42 -07:00

seerr_quadlet.bats

seerr: quadlet on dankclaw + guard-chain vhost + deployer wiring

2026-09-01 14:40:10 -07:00