docs: record the two-slot no-spec frank-small shape (measured 1,397 MiB free, 48.0 t/s)

Runbook reshaped: 2 x 131072 no-spec identity, slot-2 arithmetic (drafter ~0.4 GiB + ubatch ~0.3 GiB bought the second 4,352 MiB KV slot), ngram-mod skipped on the recurrent-rollback law, MTP references kept (44.8-52.1% acceptance, 58.9-66.9 t/s), rollback = one revert of 812d9eb. AGENTS fleet row + section, LLM/index.md intro + entry, root index entry all flipped to the 2026-10-06 shape. 360/360 suite green; e2e gate 33/33 green at deploy.
2026-10-06 00:15:55 -07:00
parent 812d9ebff5
commit 5e166543fa
4 changed files with 134 additions and 80 deletions
@@ -370,11 +370,13 @@ The LLM inference fleet on the two hosts. Full index:
 - [[kingjones-strix-mtp]] — the kingjones Qwen3.8-27B ROCmFP4 STRIX MTP model on Dankclaw (active)
 - [[dealign-ornith-crack]] — the retired Ornith-1.5-35B-A3B CRACK model on Dankserver (retired 2026-09-02)
 - [[frank-small-llama-swift15-iq3s-mtp-131072]] — the ACTIVE frank-small
-  runbook since 2026-10-05 (evening): llama.cpp master (CUDA sm_86) serving
-  ukisai's Swift-1.5-Qwen3.8-27B GSQ-RCO IQ3_S WITH the in-file MTP head on
-  the RTX 3090 — ONE 131,072-token conversation at Frank's 128k cap, q8_0
-  K + q8_0 V, vision through the base-model projector; the arithmetic that
-  makes one slot the maximum
+  runbook since 2026-10-05 (evening; **2 × 131,072 no-spec since
+  2026-10-06**): llama.cpp master (CUDA sm_86) serving ukisai's
+  Swift-1.5-Qwen3.8-27B GSQ-RCO IQ3_S (the -mtp file's head present but NOT
+  drafted — speculation off) on the RTX 3090 — TWO 131,072-token
+  conversations at Frank's 128k cap, the tight fit he ordered (1,397 MiB
+  measured free), q8_0 K + q8_0 V, vision through the base-model
+  projector, ~48 t/s without the drafter
 - [[frank-small-llama-mimo-q6k-2x200704]] — RETIRED 2026-10-05 (evening,
  superseded by swift15): llama.cpp master serving
  bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** — TWO conversations at