llm(frank-archon): swap payload to the publisher's iq4r .rad, shape verbatim

Model swap on the radiance endpoint: MODEL_FILE moves from the in-house qwen4exp-swift15-w4dn8-i8-hc8m.rad (116,416 MiB) to the engine author's published qwen3.8-next-flash-fp8-iq4r-moe.rad (116,322 MiB, official Qwen3.8-Flash-Next bf16 -> 4-bit non-uniform codebook experts + int8 trunk, card KL 0.0789 / top-1 92.85 % vs bf16). NO argument changed: 25600/5120 vram pair, 44928 host pool, fp8 KV, 3 x 200000, MTP depth 2, wht6, MNBT 2048, froggeric v22.5 — the 2026-10-13 shape carries verbatim. New fetch script scripts/download-frank-archon-iq4r.sh (hfget + exact byte count 121,969,901,568 + LFS sha256, --verify-only default, ungated, no token on the command line). Unit/serve/deployer lore re-keyed; the seam pins the new payload id + sha256 and keeps the w4dn8 rollback provenance. Homepage card points at the publisher repo. Rollback: revert this commit (w4dn8 .rad stays on disk). The fp8-native rad was deleted from dankserver 2026-10-15 (Frank's one-time rm, volume for this payload); rebuild path documented.
2026-10-15 04:10:50 -07:00
parent a9d45e7012
commit 6dcf4a5913
7 changed files with 180 additions and 65 deletions
@@ -0,0 +1,83 @@
+#!/usr/bin/env bash
+# download-frank-archon-iq4r.sh — payload fetch/verify for the frank-archon
+# swap to the PUBLISHER's 4-bit-codebook container:
+# StillDeadcode/qwen3.8-next-flash-fp8-iq4r-moe — the official
+# Qwen/Qwen3.8-Flash-Next bf16 checkpoint rad-converted by the engine's own
+# author into ONE .rad: routed experts as 4-bit codes into a 16-level
+# non-uniform codebook (Walsh–Hadamard rotation, GPTQ + coordinate-descent,
+# 10M-token calibration), ten bf16-protected experts per layer, int8 trunk +
+# lm_head, fp8 HC mixtures, the PLE n-gram table at fp8 fixed scale, the MTP
+# head, and the bf16 vision tower. File:
+# qwen3.8-next-flash-fp8-iq4r-moe.rad — 121,969,901,568 B (113.6 GiB,
+# 116,322 MiB), card KL 0.0789 all-tokens / top-1 92.85 % vs bf16.
+# Repo is UNGATED — no token needed (never put one on the command line).
+#
+#   bash scripts/download-frank-archon-iq4r.sh --fetch         resume/complete
+#   bash scripts/download-frank-archon-iq4r.sh                 verify only
+#
+# Fetch uses the vendored scripts/hfget.sh (curl+jq only): per-file size
+# checks against the Hub listing, `-C -` resume, disk-fit gate. The side
+# files (LICENSE, README, the w4nl recipe) stay in the staging dir as
+# provenance; the serve gate mounts ONLY /home/dank/models/rad, so the
+# verified .rad alone moves into it.
+#
+# Verify (default) is the AGENTS.md law in two parts: the file lands at the
+# final path with the Hub's EXACT byte count, and its sha256 equals the
+# Hub's LFS oid. A truncated transfer is a guaranteed long-timeout boot
+# without this gate.
+set -euo pipefail
+
+REPO="StillDeadcode/qwen3.8-next-flash-fp8-iq4r-moe"
+RAD_NAME="qwen3.8-next-flash-fp8-iq4r-moe.rad"
+STAGE="/home/dank/models/StillDeadcode/qwen3.8-next-flash-fp8-iq4r-moe"
+DEST="/home/dank/models/rad/$RAD_NAME"
+SIZE=121969901568
+SHA256="0af5e96244e80c21ac8edca1719dae49b8a201b94a2f3994c3e24026ceaa4d20"
+SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
+
+mode="verify"
+[[ "${1:-}" == "--fetch" ]] && mode="fetch"
+
+if [[ "$mode" == "fetch" ]]; then
+    # HFGET_JOBS=4 is hfget's default (a few streams saturate the link).
+    bash "$SCRIPT_DIR/hfget.sh" "$REPO" "$STAGE" main
+
+    staged="$STAGE/$RAD_NAME"
+    if [[ ! -f "$staged" ]]; then
+        echo "FETCH FAILED: $staged absent after hfget" >&2
+        exit 1
+    fi
+    got=$(stat -c %s "$staged")
+    if [[ "$got" != "$SIZE" ]]; then
+        echo "FETCH FAILED: staged .rad is $got B, want $SIZE B" >&2
+        exit 1
+    fi
+    echo "staged .rad byte-exact ($SIZE B); hashing (one full read, minutes)"
+    got_sha=$(sha256sum "$staged" | cut -d' ' -f1)
+    if [[ "$got_sha" != "$SHA256" ]]; then
+        echo "FETCH FAILED: sha256 $got_sha, want $SHA256 — DELETE the staged" \
+             "file before re-fetching (curl -C - cannot repair a corrupt body)" >&2
+        exit 1
+    fi
+    mkdir -p "$(dirname "$DEST")"
+    mv "$staged" "$DEST"
+    echo "payload placed: $DEST"
+fi
+
+echo "verifying deployed payload: $DEST"
+if [[ ! -f "$DEST" ]]; then
+    echo "  BAD  payload absent: $DEST" >&2
+    exit 1
+fi
+got=$(stat -c %s "$DEST")
+if [[ "$got" != "$SIZE" ]]; then
+    echo "  BAD  payload is $got B, want $SIZE B" >&2
+    exit 1
+fi
+echo "byte-exact ($SIZE B); hashing (one full read, minutes)"
+got_sha=$(sha256sum "$DEST" | cut -d' ' -f1)
+if [[ "$got_sha" != "$SHA256" ]]; then
+    echo "  BAD  sha256 $got_sha, want $SHA256" >&2
+    exit 1
+fi
+echo "payload verified: $RAD_NAME, size and sha256 match the Hub LFS oid"