docs(index): frank-small summaries carried the superseded 2,849 MiB free figure

Both indexes stated the pre-doubling VRAM as current. Now 2,279 MiB free with
the 4096/2048 pair named, so no index contradicts the runbook it links to.
This commit is contained in:
Frank
2026-10-05 16:03:18 -07:00
parent 67141c8c02
commit aa9908257d
2 changed files with 4 additions and 2 deletions
+2 -1
View File
@@ -86,7 +86,8 @@ frank-small, port 7771]
bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** on the RTX 3090, TWO
slots of 200,704 tokens (pool 401,408) with FULLY UNQUANTIZED KV (f16 K +
f16 V) and the mmproj for vision — 94.4 tok/s decode (the rung costs a
measured -10 % vs Q5_K_M: weight-bandwidth-bound), 2,849 MiB of the card
measured -10 % vs Q5_K_M: weight-bandwidth-bound), batch 4096 / ubatch 2048
since 2026-10-05 (+4.6 % prefill, measured), 2,279 MiB of the card
left free. Probe-size trap (>=256 px images or the model says "video")
documented. Rollback: one MODEL_FILE line back to Q5_K_M
- [[frank-small-llama-mimo-q5km]] — **RETIRED 2026-10-02 → 10-03 (rollback
+2 -1
View File
@@ -293,7 +293,8 @@ The LLM inference fleet on the two hosts. Full index:
bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** on Dankclaw's RTX 3090,
port 7771 — TWO conversations at 200,704 tokens each with fully
unquantized f16 KV and mmproj vision; 94.4 tok/s decode (the Q6_K rung
costs a measured −10 % vs Q5_K_M — weight-bandwidth), 2,849 MiB free, and
costs a measured −10 % vs Q5_K_M — weight-bandwidth), batch 4096 / ubatch
2048 (+4.6 % prefill, measured 2026-10-05), 2,279 MiB free, and
the ≥256 px image-probe trap (tiny images answer "video")
- [[frank-small-llama-mimo-q5km]] — RETIRED 2026-10-02 → 10-03 (rollback
target, payload on disk; owns the measured boot-pair table): same runtime