From 2def6282b585a438ae0eb7e6a80b5d20d9129b54 Mon Sep 17 00:00:00 2001 From: Frank Date: Sat, 17 Oct 2026 20:58:55 -0700 Subject: [PATCH] docs(frank-archon): rollback re-key after 2026-10-17 disk purge The Swift1.5 w4dn8 .rad, the GLM-4.7 GGUF, and every derived model cache were purged from dankserver (trash-staged, emptied with approval; 763 GiB free). Rollback of the iq4r swap is now an HF re-download of the byte-exact frank8465 mirror (LFS sha256 09dd9306...). Corrects the w4dn8 runbook header (still said LIVE) and rebuilds both Rollback sections; log.md carries the purge record. --- AGENTS.md | 15 +++++---- .../LLM/frank-archon-radiance-qwen38-iq4r.md | 18 ++++++++--- .../frank-archon-radiance-swift15-w4dn8.md | 32 ++++++++++++------- serverAppConfigs-docs/log.md | 31 ++++++++++++++++++ 4 files changed, 75 insertions(+), 21 deletions(-) diff --git a/AGENTS.md b/AGENTS.md index be9fbed..af008fd 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -25,7 +25,7 @@ merge absorbed the former `vllmScripts` repo, history preserved). | Target | Service | Runtime | Model | Port | |--------|---------|---------|-------|------| -| Dankserver | `frank-archon` | **radiance** (StillDeadcode, **pin 1.0.13** digest-pinned `stilldeadcode/radiance@sha256:4c3f484564…`, plain `podman run`, root systemd unit) | **Publisher payload** (swap 2026-10-15, MODEL_FILE-only): `StillDeadcode/qwen3.8-next-flash-fp8-iq4r-moe` → **`qwen3.8-next-flash-fp8-iq4r-moe.rad`** (121,969,901,568 B = **116,322 MiB**, Hub-LFS sha256 `0af5e962…` verified at fetch by `scripts/download-frank-archon-iq4r.sh`) — the OFFICIAL Qwen3.8-Flash-Next bf16 checkpoint rad-converted by the engine's author: routed experts as **4-bit codes into a 16-level non-uniform codebook** (128-pt Walsh–Hadamard rotation, GPTQ on a 10M-token calibration + 3 coordinate-descent sweeps, E4M3 scales per 64 weights), **10 whole bf16-protected experts/layer**, int8 W8A8 trunk/lm_head, fp8 HC mixtures, fp8 fixed-scale PLE n-gram (47.7 GiB), **MTP head + bf16 vision tower in the container**; card KL 0.0789 mean all-tokens / top-1 92.85 % vs BF16. **Base-alignment (censored) model** — the abliterated family lives on frank-dragoon. Shape carried VERBATIM from the 2026-10-13 record: **3 × 200,000 fp8-KV** (`--max-num-seqs 3`), **25,600 MiB slab + 5,120 MiB pool = 30,720 of the 30,969 MiB claimable**, 44 GiB/rank pinned host pool, PLE pinned to RAM, MTP depth 2, MNBT 2048, Froggeric v22.5 template. Decode/prefill ladders in the runbook are the **w4dn8 record** (the bar to beat; new-payload probes pending). Rollback: revert the swap commit (w4dn8 `.rad` on disk); the fp8-native `.rad` + the raw Swift1.5 BF16 source were DELETED from disk 2026-10-15 (Frank's one-time rm, volume for this payload; rebuildable via the fetch/build scripts). | 7770 | +| Dankserver | `frank-archon` | **radiance** (StillDeadcode, **pin 1.0.13** digest-pinned `stilldeadcode/radiance@sha256:4c3f484564…`, plain `podman run`, root systemd unit) | **Publisher payload** (swap 2026-10-15, MODEL_FILE-only): `StillDeadcode/qwen3.8-next-flash-fp8-iq4r-moe` → **`qwen3.8-next-flash-fp8-iq4r-moe.rad`** (121,969,901,568 B = **116,322 MiB**, Hub-LFS sha256 `0af5e962…` verified at fetch by `scripts/download-frank-archon-iq4r.sh`) — the OFFICIAL Qwen3.8-Flash-Next bf16 checkpoint rad-converted by the engine's author: routed experts as **4-bit codes into a 16-level non-uniform codebook** (128-pt Walsh–Hadamard rotation, GPTQ on a 10M-token calibration + 3 coordinate-descent sweeps, E4M3 scales per 64 weights), **10 whole bf16-protected experts/layer**, int8 W8A8 trunk/lm_head, fp8 HC mixtures, fp8 fixed-scale PLE n-gram (47.7 GiB), **MTP head + bf16 vision tower in the container**; card KL 0.0789 mean all-tokens / top-1 92.85 % vs BF16. **Base-alignment (censored) model** — the abliterated family lives on frank-dragoon. Shape carried VERBATIM from the 2026-10-13 record: **3 × 200,000 fp8-KV** (`--max-num-seqs 3`), **25,600 MiB slab + 5,120 MiB pool = 30,720 of the 30,969 MiB claimable**, 44 GiB/rank pinned host pool, PLE pinned to RAM, MTP depth 2, MNBT 2048, Froggeric v22.5 template. Decode/prefill ladders in the runbook are the **w4dn8 record** (the bar to beat; new-payload probes pending). Rollback: re-download the w4dn8 `.rad` from the HF mirror `frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700` (LFS sha256 `09dd9306…`) + revert the swap commit — the local copy was **purged 2026-10-17** (it was the last non-iq4r model on the host; the GLM-4.7 GGUF, the radiance kvcache tiers, and every stale compile cache went in the same purge, 763 GiB free). The fp8-native `.rad` + the raw Swift1.5 BF16 source were DELETED from disk 2026-10-15 (Frank's one-time rm, volume for this payload; rebuildable via the fetch/build scripts). | 7770 | | Dankclaw | `frank-dragoon` | **halogen-flash-server 0.16.2** (`ghcr.io/peonist-ai/halogen-flash-server@sha256:0c61bf84…`, digest-pinned, plain `podman run` via `scripts/serve-frank-dragoon.sh`, root systemd unit) | Quat3rnion/halogen-swift1.5-qwen3.8-flash-next-v2-abliterated **`qwen38-flash-next-v2-swift15-abliterated.hgn`** (66,687,678,464 B = compacted r2 of the card's 89,775,868,032 B original, ~62 GiB resident; the v2 `.hgn` format loads in NO other engine), **+ REQUIRED `qwen38-flash-next-ngram.hgn`** (51,200,246,144 B, peonist @5cc17cea — read beside the checkpoint) **+ vision tower** (897,916,416 B, @e053f488 — **vision ON**, `image_url` parts only, ≥256 px probes), **MTP spec decode ALWAYS-ON (`HALOGEN_SPEC_ADAPT=0` — the adaptive default disables the drafter per request and HALVES decode)**, MTP head INSIDE the checkpoint (`HALOGEN_MTP_HEAD` unset; no sidecar fetched), **2 slots × 262,144 ctx** (KV pool 524,288 positions ≈ 14.0 GiB at ~28 KiB/position; the 27B slots>1-disables-drafting law does NOT carry over — batching and speculation coexist, the card's quickstart ships 2 with the head), harness window 217,088 = ceiling − 45k estimate headroom, **server-side sampler 1.0/0.95/20** (card recipe; models.yml extraBody matches), coupled cap/timeout 65536/7200, prompt cache ON by default (warm 100k turn ≈ 2 s vs ≈ 88 s cold)|7770| | Dankclaw | `frank-zealot` | **llama.cpp PrismML fork build** (vendor release `0.2.0-dev` build **10754**, commit `2459f68b5`; root systemd unit, relinked — the ONLY loader for this payload) | `prism-ml/Ternary-Bonsai-2-27B-gguf` **PQ2_0** (7,206,168,928 B, sha256 `3907dc16…`; `qwen35` hybrid: **64 blocks, 16 full-attention + 48 Gated DeltaNet**, 4 KV heads × 256 dim, vocab 248,320, native 262,144, **no MTP head in the file**; `general.file_type 141` = custom tensor type **142** + `prism.hadamard.*` dequant metadata, which is what locks the runtime) + the publisher's own **Q8_0 mmproj** (629,246,976 B; Qwen3-VL tower, 27 blocks, 768 px, `qwen3vl_merger`) for **vision**, on the RTX 3090, **TWO 200,704-token slots** (`--ctx-size 401408 --parallel 2`), **q8_0 K + q8_0 V** under flash attention (34 KiB/token over the 16 full layers = 13,328 MiB pool; **f16 KV needs 25,088 MiB and cannot boot this card**), batch 4096 / **ubatch 2048** (measured CUDA optimum), `--log-verbosity 4`, **MTP OFF** (no head in the file). Boot 22,664 used / 1,461 free; 76.6 t/s single-stream decode, 691.7 t/s prefill at 166k. Cutover 2026-10-17 from Qwen3.5-9B-Uncensored Q6_K (same shape; payload + master CUDA build on disk as rollback). | @@ -541,9 +541,12 @@ positions): mean 0.0789 all-tokens / 0.0239 assistant turns, top-1 92.85 %. number of the 2026-10-13 shape below carries verbatim. The plugin's **one-table-one-encoding law** (fleet-measured at rad-convert declare): one expert table takes ONE encoding; only whole bf16 experts are legal -beside it. Rollback: revert the swap commit — the in-house w4dn8 `.rad` -(KLD-gated Swift1.5 conversion) stays on disk; the fp8-native `.rad` was -deleted 2026-10-15 (rebuild: `scripts/download-frank-archon.sh` + +beside it. Rollback: revert the swap commit AND re-download the in-house +w4dn8 `.rad` (KLD-gated Swift1.5 conversion) — it is **no longer on disk** +(purged 2026-10-17); the byte-exact copy is published as +`frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700` +(LFS sha256 `09dd9306…`). The fp8-native `.rad` was deleted 2026-10-15 +(rebuild: `scripts/download-frank-archon.sh` + `scripts/build-frank-archon-rad.sh`). **Shape (both R9700s, TP=2)**: `--tp-wire wht6`, `--max-num-seqs 3`, @@ -653,7 +656,7 @@ chat format — no parser flags; vision native (the 27-layer Qwen-VL tower, `radiance:*` families — the Dankclaw Prometheus scrape is re-added. Runbook: `serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md`. -Retired Swift1.5 w4dn8 era (payload on disk = rollback): `serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md`. +Retired Swift1.5 w4dn8 era (payload purged 2026-10-17; rollback = HF re-download `frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700`): `serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md`. Retired fp8-native era (payload deleted 2026-10-15, rebuildable): `serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-native-fp8.md`. Retired FreeToken era: `serverAppConfigs-docs/LLM/frank-archon-freetoken-pr587.md`. Retired vLLM era: `serverAppConfigs-docs/LLM/dankserver-qwen38-fp8-expert-offload-tuning.md`. @@ -1147,7 +1150,7 @@ Retired (rollback targets and history): | Runtime | Host | Window | Runbook | |---------|------|--------|---------| -| radiance Swift1.5-Qwen3.8-Flash-Next GPTQ w4dn8, 3×200,000 fp8-KV slab 25600 (`frank-archon`) | Dankserver | 2026-10-08 → 10-15 (rollback target — `.rad` on disk; owns the slab-slope ladder, KV dtype law, KLD campaign, and every shape law the iq4r swap carried verbatim) | `frank-archon-radiance-swift15-w4dn8.md` | +| radiance Swift1.5-Qwen3.8-Flash-Next GPTQ w4dn8, 3×200,000 fp8-KV slab 25600 (`frank-archon`) | Dankserver | 2026-10-08 → 10-15 (rollback target — `.rad` purged 2026-10-17, byte-exact re-download `frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700`; owns the slab-slope ladder, KV dtype law, KLD campaign, and every shape law the iq4r swap carried verbatim) | `frank-archon-radiance-swift15-w4dn8.md` | | llama.cpp CUDA (master) Qwen3.5-9B-Uncensored Q6_K, 2×200,704 exact f16 KV MTP-off (`frank-zealot`) | Dankclaw | 2026-10-07 → 10-17 (rollback target — payload + master CUDA build on disk; owns the 32 KiB/token 8-full-layer KV law and the 2→3-slot reslice law) | `frank-zealot-llama-qwen35-9b-q6k-2x200704.md` | | llama.cpp CUDA Gemma4-26B-A4B QAT Q4_K_M, 1×200,704 f16-K/q8_0-V MTP-off (`frank-zealot`) | Dankclaw | 2026-10-07 → 10-07 (same-day swap; rollback target — payload on disk; owns the `attention_k_eq_v` pair-billing KV law and the gemma4-assistant drafter-cost boots) | `frank-zealot-llama-gemma4-q4km-200704.md` | | ROCmFPX llama.cpp fork Qwen3.8-27B Uncensored Q6_0_ROCMFPX_AGENT + MTP (`frank-dragoon`) | Dankclaw | 2026-10-03 → 10-05 (rollback target, payload + fork build on disk) | `frank-dragoon-rocmfpx-q6agent-uncensored-mtp.md` | diff --git a/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md b/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md index 6ea3cea..1dac5e8 100644 --- a/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md +++ b/serverAppConfigs-docs/LLM/frank-archon-radiance-qwen38-iq4r.md @@ -10,7 +10,8 @@ author's published container**: StillDeadcode. Same port, alias, container name, systemd unit, digest-pinned engine pin **1.0.13** (`stilldeadcode/radiance@sha256:4c3f484564…`), and **every serving argument carried verbatim** from the 2026-10-13 shape. -Rollback: revert the swap commit — the w4dn8 `.rad` stays on disk. +Rollback: re-download the w4dn8 `.rad` from the HF mirror + point +`MODEL_FILE` at it (the local copy was purged 2026-10-17, see Rollback). ## The payload @@ -129,9 +130,18 @@ the same file. Revert the swap commit (`scripts/frank-archon.env` MODEL_FILE line) + redeploy: `/home/dank/models/rad/qwen4exp-swift15-w4dn8-i8-hc8m.rad` -(116,416 MiB) stays on disk, KLD-gated, same shape. The fp8-native era is -rebuild-only (see the cutover record). The w4dn8 runbook keeps every shape -law, the KV dtype table, the slab ladder, and the tuning levers: +(116,416 MiB), KLD-gated, same shape — **no longer on disk**. The 2026-10-17 +disk purge (Frank's approval, trash-staged then emptied: 763 GiB free after) +removed it; the byte-exact copy lives on the Hub as +`frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700` +(`qwen4exp-w4nl64-i8-hc8m.rad`, 122,071,973,888 B, LFS sha256 `09dd9306…`) +and re-fetches through `scripts/download-frank-archon-iq4r.sh`'s +hfget/verify pattern retargeted at that repo. The same purge deleted the +`radiance-state` kvcache tiers, `~/.radiance-cache-w4a8-*`, +`~/.cache/frank-primary`, and `/opt/vllm/moremodels` (GLM-4.7 GGUF) — all +derived or retired. The fp8-native era is rebuild-only (see the cutover +record). The w4dn8 runbook keeps every shape law, the KV dtype table, the +slab ladder, and the tuning levers: [[frank-archon-radiance-swift15-w4dn8]]. ## Related diff --git a/serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md b/serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md index 7a938ab..ab7a38e 100644 --- a/serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md +++ b/serverAppConfigs-docs/LLM/frank-archon-radiance-swift15-w4dn8.md @@ -1,6 +1,6 @@ # frank-archon — Radiance (StillDeadcode), Swift1.5 Qwen3.8-Flash-Next W4Dn8, 2× R9700 TP=2 -**Status: LIVE — deployed 2026-10-08 (main `3ca64e1`, e2e 33/33).** · **Host:** Dankserver (192.168.0.235) · **Port:** 7770 · **GPU:** 2× Radeon AI PRO R9700 (gfx1201), TP=2 +**Status: RETIRED — superseded 2026-10-15 by the publisher iq4r payload.** · Lived 2026-10-08 → 10-15 (main `3ca64e1`, e2e 33/33). · **Host:** Dankserver (192.168.0.235) · **Port:** 7770 · **GPU:** 2× Radeon AI PRO R9700 (gfx1201), TP=2 The FP8-native era (`qwen4exp-fp8-native.rad`, 173.0 GiB, no-recipe convert) is replaced by a **GPTQ-calibrated 4-bit container** of @@ -9,10 +9,10 @@ finetune) converted with the recipe `scripts/recipes/qwen4exp-swift15-w4dn8-i8-hc8m.recipe` on engine **1.0.13** (`stilldeadcode/radiance@sha256:4c3f484564…` — same digest as the FP8-native era; 1.2.0 was used ONLY for the calibration serve). -Same port, alias, container name, systemd unit. Rollback: revert the -`MODEL_FILE` line in `scripts/frank-archon.env` + redeploy — -`/home/dank/models/rad/qwen4exp-fp8-native.rad` stays on disk (trash -policy; 173 GiB, purge when the window closes). +Same port, alias, container name, systemd unit, and every serving argument +carried into the successor: [[frank-archon-radiance-qwen38-iq4r]]. The +`.rad` itself was purged from disk 2026-10-17; the byte-exact payload +lives on the Hub — see Rollback. ## Why this swap @@ -594,15 +594,25 @@ probe; `reasoning_effort` fold; Prometheus target green; `tests/run.sh` | Layer | Path | |---|---| -| FP8-native radiance (immediate) | revert `MODEL_FILE` in `scripts/frank-archon.env` + redeploy; `qwen4exp-fp8-native.rad` (173.0 GiB) on disk | +| Publisher iq4r (successor) | [[frank-archon-radiance-qwen38-iq4r]] — the LIVE payload since 2026-10-15 | +| FP8-native radiance | rebuild-only — the `.rad` (173.0 GiB) was `rm`'d 2026-10-15: `scripts/download-frank-archon.sh` + `scripts/build-frank-archon-rad.sh` | | FreeToken PR #587 | git tag `frank-archon-freetoken-pr587-20261005` | | tcclaviger vLLM shape G | git tag `frank-archon-vllm-shapeG-20261003` | -Campaign artifacts on disk: BF16 checkpoint (335 GiB), `kld-ref` (24 -GiB), grams (`/home/dank/corpora/calib`), corpora JSONL, logs -`/home/dank/logs/swift15_*.log`. The BF16 `.rad` container is deleted -before the final convert (disk gate) — the raw checkpoint is the -re-convert source if the window ever reopens. +**This era's own payload** (`qwen4exp-swift15-w4dn8-i8-hc8m.rad`, +116,416 MiB) was purged in the 2026-10-17 disk cleanup (trash-staged, then +emptied with Frank's approval). The byte-exact container is published as +`frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700` +(`qwen4exp-w4nl64-i8-hc8m.rad`, 122,071,973,888 B, Hub LFS sha256 +`09dd93064365009c508b59012adadab6a36791a50fa319f76b31bf359c01e9ff`) — +re-download restores the exact payload; a full re-convert is no longer +possible without re-fetching a BF16 source (see next paragraph). + +Campaign artifacts: the raw BF16 checkpoint was `rm`'d 2026-10-15 (Frank's +one-time authorization), so re-convert needs a fresh BF16 source; `kld-ref` +(24 GiB), grams (`/home/dank/corpora/calib`), corpora JSONL, and the logs +`/home/dank/logs/swift15_*.log` remain. The BF16 `.rad` container was +deleted before the final convert (disk gate). ## Links diff --git a/serverAppConfigs-docs/log.md b/serverAppConfigs-docs/log.md index 3c76e97..2dec8db 100644 --- a/serverAppConfigs-docs/log.md +++ b/serverAppConfigs-docs/log.md @@ -1865,3 +1865,34 @@ every restart since the cutover. backup `webui.db.bak-20261017a`; no `open-webui` restart forced — the cached list picks it up on the next one, and forcing it logs every family session out for one cosmetic string). + +## 2026-10-17 — dankserver disk purge: Swift w4dn8 rollback + orphan caches (docs re-key) + +- Ask: "dump the swift rollback and the GLM GGUF — make sure the model + caches and agenttrash are empty as well." Preflight first: `lsof` empty + on both payloads, serving trio names only the iq4r path, and a podman + layer census proved no deleted path backs an image container (the 121 GB + `16b6663d…` layer is the ENGINE image, not a model blob). +- Staged to `/home/dank/.AGENTTRASH/20261017-dump-payloads-caches`, then + purged with Frank's approval: the Swift1.5 w4dn8 `.rad` (113.6 GiB, + rollback target), `GLM-4.7-Flash-UD-Q5_K_XL.gguf` (21 GiB, `/opt/vllm` + dir removed — last non-iq4r model on the box), `radiance-state` kvcache + tiers (69 GiB + 61 MiB, derived), `~/.radiance-cache-w4a8-*` (11 GiB + stale-pin compile cache), `~/.cache/frank-primary` (4.7 GiB stale-name + cache). Also emptied every `.AGENTTRASH` on the host (14 dirs: dated + batches, quadlet/config holds, both checkouts, `/etc/caddy`). 543 → 763 + GiB free. +- Recovery: the w4dn8 payload is byte-exact on the Hub as + `frank8465/Swift-1.5-Qwen3.8-Flash-Next-GPTQ-W4A8-Radiance-AMD-R9700` + (122,071,973,888 B, LFS sha256 `09dd9306…`) — rollback is now a + re-download, not a local file. Corpora (grams 41 G, kld-ref 24 G, + calibration JSONL) deliberately KEPT: re-convert and KLD-gate inputs. +- Post-checks: frank-archon active, `/health` ok; iq4r serving payload + byte-size intact; live kvcache tier (122 MiB) untouched; no process + references a deleted path. +- Docs re-keyed: AGENTS.md fleet row + frank-archon section + both runbook + index rows; iq4r runbook Rollback rewritten (HF re-fetch procedure — the + fetch script's REPO/RAD_NAME/STAGE/DEST/SIZE/SHA256 constants are + hardcoded, so retargeting at the mirror is a script edit); w4dn8 runbook + header corrected (was still "LIVE", never updated at retirement) and its + Rollback table rebuilt.