Frank f2575a1018 frank-secondary: 2×114688 ctx (112k per-slot), ubatch 1024 ...

Lower per-slot context from 131,072 (128k) to 114,688 (112k) to free
~1 GiB of KV, which funds the ubatch 512 -> 1024 increase (prefill
throughput). The per-slot window is the product contract, so models.yml
contextWindow follows to 114,688.

- CTX_SIZE: 262144 -> 229376 (2 × 114,688)
- UBATCH_SIZE: 512 -> 1024
- Test 194: per-slot 131072 -> 114688
- KV budget test: 131072 -> 114688, ubatch 512 -> 1024

2026-10-06 16:38:58 -07:00

..

.AGENTTRASH

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

autoresearch

autoresearch arms: add D/E context arms (KV 4.05e9 = 2.00x under MTP3; E adds MNBT 4096 + util 0.99)

2026-10-02 23:52:04 -07:00

patches

frank-primary: roll back to qwen FP8 + MTP4 (2339fae trio)

2026-09-30 20:13:23 -07:00

autoresearch-bench.py

frank-large: roll back to gufo Qwen3.8-27B Q4_K_XL, one session x 262144 f16 KV

2026-10-01 22:40:59 -07:00

autoresearch-frank-primary.sh

frank-primary: autoresearch bench harness (decode t/s @32k)

2026-10-06 03:53:55 -07:00

bench_tb_fixed.py

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

bench-batch-ubatch.sh

scripts: fix the unbound local that killed the sweep at its first cell

2026-09-16 21:43:09 -07:00

bench-conversation.py

test(bench): drop the pre-probe from the conversation battery

2026-09-20 17:51:27 -07:00

bench-decode.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-llm-soak.py

bench: commit the harnesses the frank-medium numbers came from

2026-09-16 06:59:44 -07:00

bench-threads-batch-http.py

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-threads-batch.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-turn-latency.py

frank-medium: the agent-loop shape on one slot, and a harness header that matches the runtime

2026-09-16 15:38:20 -07:00

bench-ubatch.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

build-frank-primary-rad.sh

frank-primary: never write the stage index through the raw symlink

2026-10-06 00:03:58 -07:00

build-gufo.sh

frank-large: replace stock llama.cpp with gufo (gufo-org/gufo) on Dankclaw

2026-09-28 22:08:29 -07:00

build-kairic-edge-gfx1151.sh

frank-large: swap to Kairic Edge 27B IU4 (W4A4) on Strix Halo

2026-09-21 18:56:35 -07:00

build-llama-rdna4.sh

build-llama-rdna4: bundle librocm-core

2026-09-20 15:25:09 -07:00

build-rocmfpx.sh

frank-large: ROCmFPX llama.cpp on the Q8_0_ROCMFPX_AGENT file, MTP drafting

2026-10-02 00:47:16 -07:00

check-vault-links.py

docs: three dangling links, and a gate so they cannot accumulate

2026-09-16 07:43:33 -07:00

dankserver-route-primary.sh

add conversation-token battery and eno1 route preference

2026-09-20 15:25:09 -07:00

dankstatus.sh

chore(llm): add dankstatus.sh — one verified parse path for Dankserver state

2026-09-28 23:27:50 -07:00

deploy-open-webui-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-pihole-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-plan.py

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

deploy-remote.sh

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

deploy-searxng-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy.sh

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

download-frank-large-flashnext.sh

frank-large: cutover to flash-server v2 (abliterated Swift1.5)

2026-10-06 03:07:40 -07:00

download-frank-large-halogen.sh

frank-large: correct the halogen payload contract to the Hub's truth

2026-10-05 16:45:12 -07:00

download-frank-large-kingjones-uncensored.sh

frank-large: swap to the uncensored Q6_0_ROCMFPX_AGENT payload

2026-10-03 02:04:22 -07:00

download-frank-large-kingjones.sh

fetch: kingjones Q8_0_ROCMFPX_AGENT payload, frank-small Q5_K_M GGUF

2026-10-01 23:50:52 -07:00

download-frank-large-orca.sh

frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

2026-09-19 01:42:37 -07:00

download-frank-large-q4.sh

frank-large: Q4_K_XL payload + 4 x 163840 sessions (f16 KV)

2026-10-01 14:08:50 -07:00

download-frank-large-swift.sh

fetch: add the Swift-1.5 frank-large candidate download

2026-09-28 22:48:53 -07:00

download-frank-large-unsloth.sh

fix(frank-large): load the model as its native 3-way split, not a concatenated file

2026-09-21 13:58:54 -07:00

download-frank-large.sh

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

download-frank-primary.sh

frank-primary: radiance native-FP8 TP=2 cutover (engine, payload build, rollback)

2026-10-05 23:26:51 -07:00

download-frank-secondary.sh

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

dump-gguf.py

frank-primary: pin the -ot override set to the real tensor names

2026-09-26 19:51:57 -07:00

frank-large.env

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

frank-large.service

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

frank-primary-expert-activity.py

frank-primary: measure expert routing; block choice is immaterial

2026-09-26 21:58:03 -07:00

frank-primary.env

MAX_SEQS 2->3: decode 33.06 t/s (+2.0% over depth-2 32.40; +4.2% over baseline). Bigger batch headroom co-schedules concurrent decode streams (decode is weight-streaming bound, so a fuller batch amortizes the weight read). KV pool 600k tokens (3x200k), above the 400k floor. Draft acceptance unchanged (0.755).

2026-10-06 04:18:53 -07:00

frank-primary.service

frank-primary: radiance native-FP8 TP=2 cutover (engine, payload build, rollback)

2026-10-05 23:26:51 -07:00

frank-secondary.env

frank-secondary: 2×114688 ctx (112k per-slot), ubatch 1024

2026-10-06 16:38:58 -07:00

frank-secondary.service

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

generate-prompts.py

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

hf-fetch.sh

hf-fetch: only pass -C - when a non-empty partial exists

2026-09-26 15:23:24 -07:00

hf-manifest.py

hf-manifest.py: follow the 307 resolve-cache redirect for non-LFS files

2026-09-26 22:50:17 -07:00

hfget.sh

frank-primary: radiance native-FP8 TP=2 cutover (engine, payload build, rollback)

2026-10-05 23:26:51 -07:00

homepage-status.py

homepage: sectioned panels, WIP open/closed, current model facts, Tautulli card

2026-09-21 13:20:15 -07:00

homepage-status.service

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

homepage-status.timer

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

mount-entropy.sh

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

qwen38-froggeric-v22.5.jinja

frank-primary: radiance native-FP8 TP=2 cutover (engine, payload build, rollback)

2026-10-05 23:26:51 -07:00

qwen-sharp-v22.4.0.jinja

retire frank-medium: tests, planning and observability ground on frank-primary

2026-09-26 19:25:46 -07:00

searxng-render-settings.py

searxng: wire paid Kagi engine with deploy-time key rendering

2026-09-26 23:25:55 -07:00

serve-frank-large.sh

frank-large: host-RAM pin-gate preflight in serve-frank-large.sh

2026-10-06 12:58:34 -07:00

serve-frank-primary.sh

frank-primary: persist rad-tune kernel cache on a host mount

2026-10-06 03:02:51 -07:00

serve-frank-secondary.sh

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

signal-relay.py

relay: restore SIGNAL_CLI constant dropped by a boundary-repaired edit

2026-09-17 18:38:54 -07:00

signal-relay.service

alerting: Alertmanager + Signal relay deliver firing rules to Frank's phone

2026-09-17 13:09:59 -07:00

stack-qwen38-official-fp8.py

frank-primary: merged PLE file must sort before the raw shards

2026-10-06 00:21:40 -07:00

test-changed.sh

rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)

2026-10-06 15:37:13 -07:00

tmux-resurrect.sh

feat: add tmux session snapshot and restore utility

2026-08-25 17:04:15 -07:00