log: 2026-10-06 frank-small wave (two reshapes; RCO-IQ3_XXS + MTP-on, 489 MiB free, draft ctx ~2.4 GiB measured)

This commit is contained in:
Frank
2026-10-06 01:41:23 -07:00
parent 0f7274e55a
commit bb3532dfec
+20
View File
@@ -1,6 +1,26 @@
# Bundle Change Log
## 2026-10-06
- **frank-small (Dankclaw): two Swift-1.5-27B reshapes (llama.cpp, RTX 3090).**
Morning: Frank's order "drop mtp, skip ngram, ubatch 512, two 128k
contexts" → 2×131,072 no-spec on the IQ3_S-mtp (commit 812d9eb):
22,728 used / 1,397 MiB free (the tight fit he ordered; the drafter's
~0.4 GiB + ubatch ~0.3 GiB bought the second 4,352 MiB KV slot), decode
48.0 t/s, vision `Red`. Evening: swap to
`ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF`
RCO-IQ3_XXS-mtp (10,442,827,392 B, sha256 `e13d3e74…`; 1.56 GiB lighter)
+ the publisher's own `mmproj-BF16.gguf`, MTP back on (draft-mtp depth
3) → commit da36fa3: **23,636 used / 489 MiB free** (the tightest fit in
the endpoint's history — the draft ctx measured ~2.4 GiB, built against
the target's full 262,144 context, not the 3-token proposal depth; the
lighter quant funds it), decode 63.3 t/s recipe / 72.9 temp 0 (acceptance
49.8–62.4 % vs 48.0 no-spec), vision `Red` at a 128-token budget (the
uncensored model thinks more — 64 tokens is all `reasoning_content`).
ngram-mod still skipped (recurrent-state rollback law on the qwen35
hybrid). Runbook renamed + rewritten:
`serverAppConfigs-docs/LLM/frank-small-llama-swift15-unc-iq3xxs-mtp-131072.md`.
## 2026-10-05
- **frank-primary: tcclaviger vLLM fork → FreeToken (PR #587 ROCm) on
dankserver.** Built FreeToken at PR head `77a7201` on the host into the