Frank c1a4ccbbcd feat(frank-medium): swap MXFP4 -> FP8; add the one-command swap toolchain ...

Checkpoint: just1moremodel/Qwen3.8-27B-Uncensored-MXFP4-awq ->
orcarouter/Qwen3.8-27B-Uncensored-FP8 (FP8 E4M3 block-wise, 30.9 GB / 7
shards, its own single-layer MTP head). The quantization-aware entrypoint
serves the plain FP8 path: --quantization fp8, ROCM_AITER_UNIFIED_ATTN, MTP
self-speculation (SPEC_METHOD=mtp, SPEC=8). Measured: MTP mean accept 5.66/8
(66.2% draft acceptance), KV pool auto-sized to 461,540 tokens (1.76x),
battery 85.9 t/s decode / 0.06 s TTFT / 179.7 burst-4 (vs MXFP4 92.4/0.22/
248.9). MXFP4 checkpoint stays on disk as the rollback target.

Streamlining: scripts/hf-manifest.py (generate a <filename> <size> <sha256>
manifest from the live repo tree), scripts/hf-fetch.sh (resumable, byte +
sha256 verified, idempotent fetch), scripts/swap-frank-medium.sh (generate
manifest -> download -> detect quantization -> edit the quadlet -> deploy).

Docs: new frank-medium-model-swap runbook; radiance runbook, both indexes,
AGENTS.md, and log.md flipped to the FP8 shape.

2026-09-20 21:53:00 -07:00

..

.AGENTTRASH

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

patches

frank-default-large: re-enable --flash-attn on via QSA F32-mask patch

2026-08-29 23:43:25 -07:00

bench_tb_fixed.py

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

bench-batch-ubatch.sh

scripts: fix the unbound local that killed the sweep at its first cell

2026-09-16 21:43:09 -07:00

bench-conversation.py

test(bench): drop the pre-probe from the conversation battery

2026-09-20 17:51:27 -07:00

bench-decode.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-llm-soak.py

bench: commit the harnesses the frank-medium numbers came from

2026-09-16 06:59:44 -07:00

bench-threads-batch-http.py

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-threads-batch.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

bench-turn-latency.py

frank-medium: the agent-loop shape on one slot, and a harness header that matches the runtime

2026-09-16 15:38:20 -07:00

bench-ubatch.sh

feat(llm): rename inference services dropping 'default' from names

2026-09-03 16:15:43 -07:00

build-llama-rdna4.sh

build-llama-rdna4: bundle librocm-core

2026-09-20 15:25:09 -07:00

check-vault-links.py

docs: three dangling links, and a gate so they cannot accumulate

2026-09-16 07:43:33 -07:00

dankserver-route-primary.sh

add conversation-token battery and eno1 route preference

2026-09-20 15:25:09 -07:00

deploy-open-webui-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-pihole-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy-plan.py

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

deploy-remote.sh

fix(deploy): strip the Environment=VAR= prefix, not just the first =

2026-09-20 21:31:16 -07:00

deploy-searxng-quadlet.sh

Deploy services independently by changed paths

2026-08-25 20:13:33 -07:00

deploy.sh

alerting: Alertmanager + Signal relay deliver firing rules to Frank's phone

2026-09-17 13:09:59 -07:00

download-frank-large-orca.sh

frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

2026-09-19 01:42:37 -07:00

download-frank-medium-gguf.sh

frank-medium: orcarouter Q8_0 + DFlash2 Q4_K_M, 2x160k, balanced 32:33

2026-09-19 02:10:38 -07:00

frank-large.env

frank-large: CIRU v4.4.1 Orca cutover — root unit, one stream, full context

2026-09-19 02:59:01 -07:00

frank-large.service

frank-large: CIRU v4.4.1 Orca cutover — root unit, one stream, full context

2026-09-19 02:59:01 -07:00

frank-medium-fp8.manifest

feat(frank-medium): quantization-aware entrypoint + FP8 model swap

2026-09-20 21:30:30 -07:00

frank-small.env

frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

2026-09-19 01:42:37 -07:00

frank-small.service

frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

2026-09-19 01:42:37 -07:00

generate-prompts.py

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

hf-fetch.sh

feat(frank-medium): quantization-aware entrypoint + FP8 model swap

2026-09-20 21:30:30 -07:00

hf-manifest.py

feat(frank-medium): swap MXFP4 -> FP8; add the one-command swap toolchain

2026-09-20 21:53:00 -07:00

homepage-status.py

Homepage (TDD slice 7): fix the /admin/ path + status.json perms

2026-08-23 16:49:33 -07:00

homepage-status.service

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

homepage-status.timer

Homepage (TDD slice 6): the git-driven deploy

2026-08-23 12:59:56 -07:00

mount-entropy.sh

Add CLI helper for entropy volume

2026-08-25 15:38:57 -07:00

serve-frank-large.sh

frank-large: serve script feeds the launcher its runtime root from the SDK venv

2026-09-19 03:49:04 -07:00

serve-frank-small.sh

frank-small: revert vLLM cutover — back to llama.cpp Gemma4-12B Q4_K_M

2026-09-19 01:42:37 -07:00

signal-relay.py

relay: restore SIGNAL_CLI constant dropped by a boundary-repaired edit

2026-09-17 18:38:54 -07:00

signal-relay.service

alerting: Alertmanager + Signal relay deliver firing rules to Frank's phone

2026-09-17 13:09:59 -07:00

swap-frank-medium.sh

feat(frank-medium): swap MXFP4 -> FP8; add the one-command swap toolchain

2026-09-20 21:53:00 -07:00

test-changed.sh

feat(frank-medium): cut the endpoint over to radiance TP=2

2026-09-20 18:15:27 -07:00

tmux-resurrect.sh

feat: add tmux session snapshot and restore utility

2026-08-25 17:04:15 -07:00