frank-small docs: runbook renamed + rewritten for the RCO-IQ3_XXS MTP-on shape (489 MiB free, 63.3 t/s recipe, draft ctx ~2.4 GiB measured); AGENTS, vault indexes, models.yml comment, MiMo cross-link retargeted

This commit is contained in:
Frank
2026-10-06 01:33:57 -07:00
parent da36fa32cf
commit 0f7274e55a
6 changed files with 360 additions and 316 deletions
+8 -8
View File
@@ -369,14 +369,14 @@ The LLM inference fleet on the two hosts. Full index:
- [[ciru-activefpx-promptforge]] — the RETIRED v3 CIRU PromptForge runtime on Dankclaw (superseded 2026-08-24)
- [[kingjones-strix-mtp]] — the kingjones Qwen3.8-27B ROCmFP4 STRIX MTP model on Dankclaw (active)
- [[dealign-ornith-crack]] — the retired Ornith-1.5-35B-A3B CRACK model on Dankserver (retired 2026-09-02)
- [[frank-small-llama-swift15-iq3s-mtp-131072]] — the ACTIVE frank-small
runbook since 2026-10-05 (evening; **2 × 131,072 no-spec since
2026-10-06**): llama.cpp master (CUDA sm_86) serving ukisai's
Swift-1.5-Qwen3.8-27B GSQ-RCO IQ3_S (the -mtp file's head present but NOT
drafted — speculation off) on the RTX 3090 — TWO 131,072-token
conversations at Frank's 128k cap, the tight fit he ordered (1,397 MiB
measured free), q8_0 K + q8_0 V, vision through the base-model
projector, ~48 t/s without the drafter
- [[frank-small-llama-swift15-unc-iq3xxs-mtp-131072]] — the ACTIVE
frank-small runbook since 2026-10-05 (evening; **UNCECERSED RCO-IQ3_XXS
with MTP back on since 2026-10-06 evening**): llama.cpp master (CUDA
sm_86) serving ajgazin's Swift-1.5-Qwen3.8-27B Uncensored RCO-IQ3_XXS
(the MTP head in the file is drafted) on the RTX 3090 — TWO
131,072-token conversations at Frank's 128k cap, the tightest fit in
the endpoint's history (489 MiB measured free), q8_0 K + q8_0 V, vision
through the publisher's own projector, ~63 t/s recipe decode with MTP
- [[frank-small-llama-mimo-q6k-2x200704]] — RETIRED 2026-10-05 (evening,
superseded by swift15): llama.cpp master serving
bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** — TWO conversations at