FrankandClaude 7689092db8 frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2 ...

Replace the Kairic Edge ROCmFPX build with the unsloth b11030 stock
llama.cpp prebuilt (ROCm gfx1151) serving unsloth/Qwen3.8-27B-GGUF:
UD-Q8_K_XL (a 27B dense model, 31.5 GiB) with the z-lab DFlash2 Q4_K_M
drafter (depth 4) on the gfx1151 iGPU.

Serving shape: one 262,144-token conversation, q8_0 KV (the build lacks
fp8), text-only, greedy sampling, Qwen-Sharp v22.4.0 template.

- scripts/serve-frank-large.sh: stock llama.cpp + DFlash2 spec decode
- scripts/frank-large.env: new model/drafter/runtime, 262144 ctx / 1 slot
- scripts/download-frank-large.sh: per-file fetch, verify mode, idempotent
- scripts/frank-large.service: updated description
- scripts/deploy-remote.sh: updated pkill pattern + asset gates
- tests/frank_large_unit.bats: new model/runtime/spec assertions
- docs: new runbook (active), Kairic Edge runbook retired (rollback target)

Co-Authored-By: Claude <noreply@anthropic.com>

2026-09-21 21:50:36 -07:00

..

Pipeline Parallelism

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

agentionai-fast-imatrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ciru-activefpx-promptforge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw Improvements.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw System Specs.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dankclaw-iommu-translation-off.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

Dankserver System Specs.md

docs: dankserver board swap clears the PCIe-atomics wall

2026-09-20 14:39:54 -07:00

dankserver-vram-growth.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dealign-ornith-crack.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

deployment.md

docs: the vault and AGENTS.md describe two Dankclaw endpoints

2026-09-16 14:52:51 -07:00

dflash2-large-vulkan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

DFlash DSpark Speculative Decoding.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dual-R9700-Cooperation.md

feat(monitoring,harness): follow frank-medium onto vllm:* metrics and fix red-by-construction targets

2026-09-20 19:35:56 -07:00

eemin-rocmi4-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

FastFlowLM NPU Inference.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-ciru-orca.md

docs(frank-large): unsloth Qwen3.8-Flash-Next runbook; retire the CIRU Orca runbook

2026-09-21 12:30:35 -07:00

frank-large-ik-uncensored.md

docs: the vault and AGENTS.md describe two Dankclaw endpoints

2026-09-16 14:52:51 -07:00

frank-large-kairic-edge-qwen38-27b.md

docs: document Qwen-Sharp template wiring and 73k-token diagnosis

2026-09-21 20:11:00 -07:00

frank-large-unsloth-qwen38-27b-q8xl.md

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

frank-large-unsloth-qwen38-flash-next.md

fix(frank-large): load the model as its native 3-way split, not a concatenated file

2026-09-21 13:58:54 -07:00

frank-medium-batch-ubatch.md

docs: the ubatch optimum, the rebalance, and the live atomics chain

2026-09-17 00:27:59 -07:00

frank-medium-llamacpp-dflash2.md

feat(monitoring,harness): follow frank-medium onto vllm:* metrics and fix red-by-construction targets

2026-09-20 19:35:56 -07:00

frank-medium-model-swap.md

test(frank-medium): A/B DFlash2 vs MTP on FP8 — DFlash2 wins on decode

2026-09-20 22:20:53 -07:00

frank-medium-radiance-mxfp4.md

docs(frank-medium): record the MXFP4 + clean-KV cut; correct vision claim

2026-09-21 17:08:33 -07:00

frank-medium-rocmfpx.md

docs: frank-medium is llama.cpp with DFlash2 on both cards

2026-09-16 15:15:02 -07:00

frank-npu.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

frank-redo-2026-08-17.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-small-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-small-gemma4-12b.md

docs(frank-small): record the CACHE_RAM=2048 cap in the deployed flags

2026-09-21 15:06:05 -07:00

frank-small-qwen38-gsq-rco.md

docs: frank-small is Gemma4-12B QAT now — new runbook, Qwen retired as rollback target

2026-09-17 02:18:44 -07:00

frank-small-vllm-gemma4.md

frank-small: llama.cpp -> vLLM (gemma-4-12B-it-qat-w4a16-ct, w4a16 Marlin)

2026-09-18 21:06:46 -07:00

freetoken-benchmark-sweep.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

freetoken-frank-small.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

halogen-flash-server.md

docs: frank-medium deployed-flags table + halogen retirement banner

2026-09-19 06:20:57 -07:00

Hybrid CPU GPU Processing Dankserver.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ikllama-ornith-dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

index.md

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

kairic-edge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-q8agent-rocmfpx.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

kingjones-strix-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-strix-rocmfp4.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

ling-3.0-flash-trial.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ling-3.0-flash-vllm-plan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Quantization by Hardware Architecture.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

qwen3.8-spec-matrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

qwen3.8-strix-optimizations.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

RAM CPU Offloading in VLLM.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Shared Memory Architecture Dankclaw.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ubatch-benchmark-large.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

VLLM Index.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

VLLM Overview.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

vllm_research_findings.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

x4-pair-experiment.md

the x4 link, measured: 6.72 GB/s — which decides the streaming question

2026-09-16 23:25:06 -07:00