From 3a931ce2c126d8f156b09781f594d04888f52bb8 Mon Sep 17 00:00:00 2001 From: Frank Date: Tue, 29 Sep 2026 00:00:49 -0700 Subject: [PATCH] chore(dankclaw): reclaim 510G of retired payloads; fix a stale fallback MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The disk was at 93% with 137G free. Nine retired payloads are now moved to ~/.AGENTTRASH/20260928-retired-models/ with a MANIFEST.md giving a restore command per item — moved, not deleted, and nothing is freed until the purge is approved. Every one maps to a runtime already retired in the runbook index. Only the .gguf was taken from Qwen3.8-27B-UD-Q8_K_XL/: the live frank-large DFlash2 drafter lives in that directory and stays put. The manifest warns against restoring the directory wholesale. Kept: checkpoints/ (23G) — unreferenced by the repo, but ComfyUI is live and its workflows were not searched, so it is not confirmed dead. Also logs/, because x4e-run.log is a SPARSE file (3.3G apparent, 4K real) and frees nothing. The reference check caught a live bug: serve-frank-small.sh's fallback MODEL_DIR still pointed at the retired GSQ-RCO payload frank-small served on 2026-09-16/17. frank-small.env has always overridden it, so the drift was invisible — but a missing or unreadable env file would have turned a config problem into a "missing asset" naming a model that is no longer there. Repointed at Gemma4-12B-QAT/, which the env file already sets. Not taken, by request: podman images (279G reclaimable, 95%) and the uv+pip caches (73G). Together 352G of regenerable garbage, larger than what was reclaimed here. The 29.3G payload rollback target went with the rest, so the payload-only rollback is now a re-fetch first; the runbook and AGENTS.md say so. --- AGENTS.md | 15 ++++--- scripts/serve-frank-small.sh | 10 ++++- .../LLM/frank-large-gufo-qwen38-27b.md | 10 ++--- serverAppConfigs-docs/log.md | 40 +++++++++++++++++++ 4 files changed, 63 insertions(+), 12 deletions(-) diff --git a/AGENTS.md b/AGENTS.md index 70ad084..f25c7fb 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -372,11 +372,16 @@ and a token on the curl command line is world-readable) and Both take `--verify-only`. Runbook: `serverAppConfigs-docs/LLM/frank-large-gufo-qwen38-27b.md`. -Rollback, two ways: **payload only** — repoint `MODEL_FILE` at -`/home/dank/models/Qwen3.8-27B-UD-Q8_K_XL/Qwen3.8-27B-UD-Q8_K_XL.gguf`, -intact on disk. **Engine** — [[frank-large-unsloth-qwen38-27b-q8xl]], the -b11030 prebuilt at `/home/dank/GitPackages/unsloth-llama-b11030/`; the only -way to get Qwen-Sharp back. +Rollback, two ways: **payload only** — re-fetch with +`scripts/download-frank-large.sh` and repoint `MODEL_FILE` at +`/home/dank/models/Qwen3.8-27B-UD-Q8_K_XL/Qwen3.8-27B-UD-Q8_K_XL.gguf`; that +29.3 GiB target was **reclaimed on 2026-09-28** (staged to +`~/.AGENTTRASH/20260928-retired-models/`, restorable from there), so it is +no longer a one-minute flip. **Engine** — +[[frank-large-unsloth-qwen38-27b-q8xl]], the b11030 prebuilt at +`/home/dank/GitPackages/unsloth-llama-b11030/`; the only way to get +Qwen-Sharp back. The DFlash2 drafter was never reclaimed and still lives in +`Qwen3.8-27B-UD-Q8_K_XL/`. ### frank-small — llama.cpp on the RTX 3090 (Dankclaw, ACTIVE) diff --git a/scripts/serve-frank-small.sh b/scripts/serve-frank-small.sh index 5b37367..21ebd58 100755 --- a/scripts/serve-frank-small.sh +++ b/scripts/serve-frank-small.sh @@ -47,9 +47,15 @@ fi # --- defaults (used when the env file does not set them) ------------------- : "${LLAMA_BIN:=/home/dank/GitPackages/llama.cpp-mainline/build-cuda/bin/llama-server}" -: "${MODEL_DIR:=/home/dank/models/Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp}" -: "${MODEL_FILE:=Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf}" +: "${MODEL_DIR:=/home/dank/models/Gemma4-12B-QAT}" +: "${MODEL_FILE:=Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced-Q4_K_M.gguf}" : "${MMPROJ_PATH:=$MODEL_DIR/mmproj-Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced-BF16.gguf}" +# NOTE: the fallback above was the retired ISTA-DASLab Qwen3.8-27B GSQ-RCO +# payload, which frank-small served on 2026-09-16/17 and which no longer +# exists on disk. frank-small.env has always overridden it, so the drift was +# invisible — but a missing or unreadable env file would have left this +# script pointing at a payload that is not there, turning a config problem +# into a "missing asset" that names the wrong model. : "${DRAFT_FILE:=}" : "${ALIAS:=frank-small}" : "${BIND_ADDR:=0.0.0.0}" diff --git a/serverAppConfigs-docs/LLM/frank-large-gufo-qwen38-27b.md b/serverAppConfigs-docs/LLM/frank-large-gufo-qwen38-27b.md index 5cac30e..cedbb77 100644 --- a/serverAppConfigs-docs/LLM/frank-large-gufo-qwen38-27b.md +++ b/serverAppConfigs-docs/LLM/frank-large-gufo-qwen38-27b.md @@ -276,12 +276,12 @@ The differences worth knowing: Two independent rollbacks, because two things changed on 2026-09-28: -1. **Payload only** — repoint `MODEL_FILE`/`MODEL_DIR` in - `scripts/frank-large.env` at +1. **Payload only** — repoint `MODEL_FILE` in `scripts/frank-large.env` at `/home/dank/models/Qwen3.8-27B-UD-Q8_K_XL/Qwen3.8-27B-UD-Q8_K_XL.gguf` - and redeploy. That directory is untouched on disk and the drafter already - lives in it. This is the fast way back to the stock Qwen weights on the - gufo runtime. + and redeploy. **The 29.3 GiB target was reclaimed on 2026-09-28**, so this + path now needs a re-fetch first: `scripts/download-frank-large.sh`, then + the env edit. The DFlash2 drafter was never touched and still lives in + that directory. 2. **Engine** — [[frank-large-unsloth-qwen38-27b-q8xl]]: the unsloth b11030 prebuilt is still at `/home/dank/GitPackages/unsloth-llama-b11030/`. Revert `RUNTIME_DIR` and the gufo-only tunables, restore the serve diff --git a/serverAppConfigs-docs/log.md b/serverAppConfigs-docs/log.md index 00659dd..c49a0f2 100644 --- a/serverAppConfigs-docs/log.md +++ b/serverAppConfigs-docs/log.md @@ -2,6 +2,46 @@ ## 2026-09-28 +- **Dankclaw model cleanup** (disk was at 93%, 137 G free). Frank asked to + clean up old models. **510 G staged** to + `~/.AGENTTRASH/20260928-retired-models/` — moved, NOT deleted, with a + `MANIFEST.md` giving a restore command per item. **Nothing is freed until + the purge is approved**; that is the point of the trash policy, and the + number to know before expecting the disk to move. + - Staged: CIRU Orca 128 G, halogen 123 G, unsloth Flash-Next IQ4_XS 91 G, + mradermacher IQ4_XS 91 G, unsloth 27B 29.3 G, Kairic Edge 27 G, + ISTA-DASLab GSQ-RCO 13 G, vLLM Gemma4 w4a16 9.6 G, vLLM Gemma4 drafter + 838 M. Every one maps to a runtime already retired in the runbook index. + - **The 29.3 G rollback target went with them**, by Frank's decision. The + payload-only rollback is now a re-fetch first; both the runbook and + AGENTS.md say so. **The DFlash2 drafter was NOT reclaimed** — only the + `.gguf` was taken out of that directory, because the live frank-large + drafter lives in it. The manifest warns against restoring the directory + wholesale. + - **Kept deliberately:** `checkpoints/` 23 G. It is unreferenced by the + repo, but ComfyUI is live and its workflows were not searched — not + confirmed dead, so not taken. `logs/x4e-run.log` also stays: it is a + **sparse** file, 3.3 G apparent but 4 K real, so removing it frees + nothing. + - **A live reference check came first, and it earned its keep.** + `serve-frank-small.sh`'s *fallback* `MODEL_DIR` still pointed at the + retired GSQ-RCO payload frank-small served on 2026-09-16/17. The env + file has always overridden it, so the drift was invisible — but a + missing or unreadable env file would have turned a config problem into a + "missing asset" naming a model that no longer exists. Repointed at + `Gemma4-12B-QAT/`, which is what the env file already sets. Every other + hit was a comment, a retired fetch script's destination, or + `retire_halogen_large_quadlet` (which moves a *quadlet*, not a model). + - **Not taken, by Frank's decision — scope was models only:** podman + images (**279 G reclaimable, 95%**; 170 images, 23 active) and the + uv+pip caches (**73 G**). Together that is 352 G of regenerable garbage + larger than the models reclaimed, and it is the obvious next move. + - Pre-existing: **118 G of trash from 2026-09-21** was already staged + (`20260921-frank-large-assembled` 88 G, `-redownload` 30 G) and never + purged. Total now staged on this host: **627 G**. + - Verified after the moves: frank-large and frank-small both `active`, + both `/health` 200, and all three live assets (Swift target, DFlash2 + drafter, Gemma4 target) still present. - **frank-large payload swapped to Swift-1.5 (uncensored)** (production change, Dankclaw). Frank asked whether the UD Q8 of `ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF` would load on