From bb3532dfecc6f482b1cb08a7ebf34c9301eafcf2 Mon Sep 17 00:00:00 2001 From: Frank Date: Tue, 6 Oct 2026 01:41:23 -0700 Subject: [PATCH] log: 2026-10-06 frank-small wave (two reshapes; RCO-IQ3_XXS + MTP-on, 489 MiB free, draft ctx ~2.4 GiB measured) --- serverAppConfigs-docs/log.md | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/serverAppConfigs-docs/log.md b/serverAppConfigs-docs/log.md index bf465be..ec4fbcf 100644 --- a/serverAppConfigs-docs/log.md +++ b/serverAppConfigs-docs/log.md @@ -1,6 +1,26 @@ # Bundle Change Log +## 2026-10-06 +- **frank-small (Dankclaw): two Swift-1.5-27B reshapes (llama.cpp, RTX 3090).** + Morning: Frank's order "drop mtp, skip ngram, ubatch 512, two 128k + contexts" → 2×131,072 no-spec on the IQ3_S-mtp (commit 812d9eb): + 22,728 used / 1,397 MiB free (the tight fit he ordered; the drafter's + ~0.4 GiB + ubatch ~0.3 GiB bought the second 4,352 MiB KV slot), decode + 48.0 t/s, vision `Red`. Evening: swap to + `ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF` + RCO-IQ3_XXS-mtp (10,442,827,392 B, sha256 `e13d3e74…`; 1.56 GiB lighter) + + the publisher's own `mmproj-BF16.gguf`, MTP back on (draft-mtp depth + 3) → commit da36fa3: **23,636 used / 489 MiB free** (the tightest fit in + the endpoint's history — the draft ctx measured ~2.4 GiB, built against + the target's full 262,144 context, not the 3-token proposal depth; the + lighter quant funds it), decode 63.3 t/s recipe / 72.9 temp 0 (acceptance + 49.8–62.4 % vs 48.0 no-spec), vision `Red` at a 128-token budget (the + uncensored model thinks more — 64 tokens is all `reasoning_content`). + ngram-mod still skipped (recurrent-state rollback law on the qwen35 + hybrid). Runbook renamed + rewritten: + `serverAppConfigs-docs/LLM/frank-small-llama-swift15-unc-iq3xxs-mtp-131072.md`. + ## 2026-10-05 - **frank-primary: tcclaviger vLLM fork → FreeToken (PR #587 ROCm) on dankserver.** Built FreeToken at PR head `77a7201` on the host into the