Frank e9a01cd013 frank-medium: swap to ParoQuant MXFP6 (Swift Qwen3.8-27B) + Qwen-Sharp v22.5.0 ...

- Model: hugypufy/Swift-Qwen3.8-27B-PARO-MXFP6 (25.16 GiB, 18 shards,
  quant_method=paroquant_mxfp6, bits=6, group_size=128, krot=8, rotation on)
- Image: ggz14/vllm-radiance-mxfp4:0.13.0-e060895 (PR #51 launch6_p kernel,
  built on the published 0.9.3 base; docker->podman via save/load)
- GPU_UTIL 0.98 -> 0.99 (user request); KV_DTYPE=auto (unquantized bf16)
- Entrypoint: mxfp6 branch (17 patches + paroquant kernel compile +
  sitecustomize registration); GPU_UTIL default for set -u robustness
- Quadlet: SNAP/GPU_UTIL/Image/cache updated; new mxfp6 cache dir
- deploy-remote.sh: R4D gate + paroquant_mxfp6; new image/SNAP/cache defaults
- Chat template: Qwen-Sharp v22.5.0 (peculiar-ragdoll); v22.4.0 kept as rollback
- Test 168: dflash branch comment quant-aware (mxfp4 + paroquant_mxfp6)
- Runbook: MXFP6 active shape, MXFP4 rollback

MXFP4 checkpoint remains on disk as the rollback target.

2026-09-21 22:46:44 -07:00

..

Pipeline Parallelism

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

agentionai-fast-imatrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ciru-activefpx-promptforge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw Improvements.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dankclaw System Specs.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dankclaw-iommu-translation-off.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

Dankserver System Specs.md

docs: dankserver board swap clears the PCIe-atomics wall

2026-09-20 14:39:54 -07:00

dankserver-vram-growth.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

dealign-ornith-crack.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

deployment.md

docs: the vault and AGENTS.md describe two Dankclaw endpoints

2026-09-16 14:52:51 -07:00

dflash2-large-vulkan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

DFlash DSpark Speculative Decoding.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Dual-R9700-Cooperation.md

feat(monitoring,harness): follow frank-medium onto vllm:* metrics and fix red-by-construction targets

2026-09-20 19:35:56 -07:00

eemin-rocmi4-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

FastFlowLM NPU Inference.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-large-ciru-orca.md

docs(frank-large): unsloth Qwen3.8-Flash-Next runbook; retire the CIRU Orca runbook

2026-09-21 12:30:35 -07:00

frank-large-ik-uncensored.md

docs: the vault and AGENTS.md describe two Dankclaw endpoints

2026-09-16 14:52:51 -07:00

frank-large-kairic-edge-qwen38-27b.md

docs: document Qwen-Sharp template wiring and 73k-token diagnosis

2026-09-21 20:11:00 -07:00

frank-large-unsloth-qwen38-27b-q8xl.md

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

frank-large-unsloth-qwen38-flash-next.md

fix(frank-large): load the model as its native 3-way split, not a concatenated file

2026-09-21 13:58:54 -07:00

frank-medium-batch-ubatch.md

docs: the ubatch optimum, the rebalance, and the live atomics chain

2026-09-17 00:27:59 -07:00

frank-medium-llamacpp-dflash2.md

feat(monitoring,harness): follow frank-medium onto vllm:* metrics and fix red-by-construction targets

2026-09-20 19:35:56 -07:00

frank-medium-model-swap.md

test(frank-medium): A/B DFlash2 vs MTP on FP8 — DFlash2 wins on decode

2026-09-20 22:20:53 -07:00

frank-medium-radiance-mxfp4.md

frank-medium: swap to ParoQuant MXFP6 (Swift Qwen3.8-27B) + Qwen-Sharp v22.5.0

2026-09-21 22:46:44 -07:00

frank-medium-rocmfpx.md

docs: frank-medium is llama.cpp with DFlash2 on both cards

2026-09-16 15:15:02 -07:00

frank-npu.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

frank-redo-2026-08-17.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-small-benchmark.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

frank-small-gemma4-12b.md

docs(frank-small): record the CACHE_RAM=2048 cap in the deployed flags

2026-09-21 15:06:05 -07:00

frank-small-qwen38-gsq-rco.md

docs: frank-small is Gemma4-12B QAT now — new runbook, Qwen retired as rollback target

2026-09-17 02:18:44 -07:00

frank-small-vllm-gemma4.md

frank-small: llama.cpp -> vLLM (gemma-4-12B-it-qat-w4a16-ct, w4a16 Marlin)

2026-09-18 21:06:46 -07:00

freetoken-benchmark-sweep.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

freetoken-frank-small.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

halogen-flash-server.md

docs: frank-medium deployed-flags table + halogen retirement banner

2026-09-19 06:20:57 -07:00

Hybrid CPU GPU Processing Dankserver.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ikllama-ornith-dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

index.md

frank-large: swap to stock llama.cpp serving Qwen3.8-27B UD-Q8_K_XL with DFlash2

2026-09-21 21:50:36 -07:00

kairic-edge.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-q8agent-rocmfpx.md

docs: frank-medium runbook, fleet topology and client cutover

2026-09-15 19:27:04 -07:00

kingjones-strix-mtp.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

kingjones-strix-rocmfp4.md

feat(llm): swap frank-large to halogen-flash-server, retire frank-npu

2026-09-11 14:48:28 -07:00

ling-3.0-flash-trial.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

ling-3.0-flash-vllm-plan.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Quantization by Hardware Architecture.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

qwen3.8-spec-matrix.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

qwen3.8-strix-optimizations.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

RAM CPU Offloading in VLLM.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

Running Qwen3.6 27B FP8 on Dankclaw.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Running Qwen3.6 35B A3B FP8 on Dankserver.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

Shared Memory Architecture Dankclaw.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

ubatch-benchmark-large.md

docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

2026-09-03 16:17:14 -07:00

VLLM Index.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

VLLM Overview.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

vllm_research_findings.md

docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention

2026-08-28 02:20:06 -07:00

x4-pair-experiment.md

the x4 link, measured: 6.72 GB/s — which decides the streaming question

2026-09-16 23:25:06 -07:00