docs: record the frank-small llama.cpp Q6_K cutover and the frank-large gufo rollback

serverAppConfigs-docs/LLM/frank-small-sglang-mimo-v26.md

@@ -1,7 +1,7 @@
 ---
 type: reference
-title: "frank-small on Dankclaw — SGLang, MiMo-V2.6-Distill-Qwen-9B INT8 W8A16"
-description: "The active frank-small runbook — SGLang in a self-contained python3.12 venv serving leteschlead MiMo-V2.6-Distill-Qwen-9B-INT8-W8A16-AutoRound (qwen3_5 hybrid, 9B dense, in-checkpoint MTP + vision) on the RTX 3090: identity, payload, KV arithmetic, the NEXTN spec-decode shape, the CUDA 13 nvcc toolchain the JIT needs, deployed flags, the client contract, and what to check when it misbehaves."
+title: "frank-small on Dankclaw — SGLang, MiMo-V2.6-Distill-Qwen-9B INT8 W8A16 (RETIRED)"
+description: "The RETIRED frank-small runbook (2026-10-01, hours) — SGLang in a self-contained python3.12 venv serving leteschlead MiMo-V2.6-Distill-Qwen-9B-INT8-W8A16-AutoRound (qwen3_5 hybrid, 9B dense, in-checkpoint MTP + vision) on the RTX 3090: identity, payload, KV arithmetic, the NEXTN spec-decode ghost, the CUDA 13 nvcc toolchain the JIT needs, and the measured numbers kept for the record. Replaced by [[frank-small-llama-mimo-q6k]] the same night."
 tags:
   - llm
   - frank-small
@@ -17,9 +17,10 @@ timestamp: 2026-10-01
 
 # frank-small — SGLang MiMo-V2.6-Distill-Qwen-9B INT8 W8A16 (NEXTN MTP)
 
-> **ACTIVE since 2026-10-01.** Replaces [[frank-small-gemma4-12b]]
-> (llama.cpp Gemma4-12B QAT Q4_K_M, now the rollback target). Same port
-> (7771), same alias (`frank-small`), same client contract surface.
+> **RETIRED 2026-10-01, hours after cutover.** Replaced by
+> [[frank-small-llama-mimo-q6k]] — llama.cpp CUDA on the MiMo Q6_K GGUF,
+> chosen for the asymmetric KV (f16 K + q8_0 V) SGLang cannot express.
+> The venv and the INT8 payload stay on disk as the rollback.
 
 ## Identity
 
@@ -118,8 +119,11 @@ change lands.
 
 Eight safetensors shards (12,891,718,440 B total) + tokenizer and config
 files under `/home/dank/models/MiMo-V2.6-Distill-Qwen-9B-INT8-W8A16-AutoRound/`,
-all LFS sha256-verified by `scripts/download-frank-small.sh` (`--verify-only`
-re-checks). The serve script refuses to start with a missing shard.
+all LFS sha256-verified by `old/download-frank-small-sglang-int8.sh`
+(`--verify-only` re-checks) — the script moved to `old/` when the endpoint
+cut over to llama.cpp + GGUF on 2026-10-01 night, and
+`scripts/download-frank-small.sh` now fetches the GGUF quant instead. The
+serve script refuses to start with a missing shard.
 
 ## Client contract