diff --git a/serverAppConfigs-docs/LLM/index.md b/serverAppConfigs-docs/LLM/index.md index 6e7675e..682770a 100644 --- a/serverAppConfigs-docs/LLM/index.md +++ b/serverAppConfigs-docs/LLM/index.md @@ -86,7 +86,8 @@ frank-small, port 7771] bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** on the RTX 3090, TWO slots of 200,704 tokens (pool 401,408) with FULLY UNQUANTIZED KV (f16 K + f16 V) and the mmproj for vision — 94.4 tok/s decode (the rung costs a - measured -10 % vs Q5_K_M: weight-bandwidth-bound), 2,849 MiB of the card + measured -10 % vs Q5_K_M: weight-bandwidth-bound), batch 4096 / ubatch 2048 + since 2026-10-05 (+4.6 % prefill, measured), 2,279 MiB of the card left free. Probe-size trap (>=256 px images or the model says "video") documented. Rollback: one MODEL_FILE line back to Q5_K_M - [[frank-small-llama-mimo-q5km]] — **RETIRED 2026-10-02 → 10-03 (rollback diff --git a/serverAppConfigs-docs/index.md b/serverAppConfigs-docs/index.md index 52db191..2d55e5c 100644 --- a/serverAppConfigs-docs/index.md +++ b/serverAppConfigs-docs/index.md @@ -293,7 +293,8 @@ The LLM inference fleet on the two hosts. Full index: bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** on Dankclaw's RTX 3090, port 7771 — TWO conversations at 200,704 tokens each with fully unquantized f16 KV and mmproj vision; 94.4 tok/s decode (the Q6_K rung - costs a measured −10 % vs Q5_K_M — weight-bandwidth), 2,849 MiB free, and + costs a measured −10 % vs Q5_K_M — weight-bandwidth), batch 4096 / ubatch + 2048 (+4.6 % prefill, measured 2026-10-05), 2,279 MiB free, and the ≥256 px image-probe trap (tiny images answer "video") - [[frank-small-llama-mimo-q5km]] — RETIRED 2026-10-02 → 10-03 (rollback target, payload on disk; owns the measured boot-pair table): same runtime