log: 2026-10-06 frank-small wave (two reshapes; RCO-IQ3_XXS + MTP-on, 489 MiB free, draft ctx ~2.4 GiB measured)
This commit is contained in:
@@ -1,6 +1,26 @@
|
||||
# Bundle Change Log
|
||||
|
||||
|
||||
## 2026-10-06
|
||||
- **frank-small (Dankclaw): two Swift-1.5-27B reshapes (llama.cpp, RTX 3090).**
|
||||
Morning: Frank's order "drop mtp, skip ngram, ubatch 512, two 128k
|
||||
contexts" → 2×131,072 no-spec on the IQ3_S-mtp (commit 812d9eb):
|
||||
22,728 used / 1,397 MiB free (the tight fit he ordered; the drafter's
|
||||
~0.4 GiB + ubatch ~0.3 GiB bought the second 4,352 MiB KV slot), decode
|
||||
48.0 t/s, vision `Red`. Evening: swap to
|
||||
`ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF`
|
||||
RCO-IQ3_XXS-mtp (10,442,827,392 B, sha256 `e13d3e74…`; 1.56 GiB lighter)
|
||||
+ the publisher's own `mmproj-BF16.gguf`, MTP back on (draft-mtp depth
|
||||
3) → commit da36fa3: **23,636 used / 489 MiB free** (the tightest fit in
|
||||
the endpoint's history — the draft ctx measured ~2.4 GiB, built against
|
||||
the target's full 262,144 context, not the 3-token proposal depth; the
|
||||
lighter quant funds it), decode 63.3 t/s recipe / 72.9 temp 0 (acceptance
|
||||
49.8–62.4 % vs 48.0 no-spec), vision `Red` at a 128-token budget (the
|
||||
uncensored model thinks more — 64 tokens is all `reasoning_content`).
|
||||
ngram-mod still skipped (recurrent-state rollback law on the qwen35
|
||||
hybrid). Runbook renamed + rewritten:
|
||||
`serverAppConfigs-docs/LLM/frank-small-llama-swift15-unc-iq3xxs-mtp-131072.md`.
|
||||
|
||||
## 2026-10-05
|
||||
- **frank-primary: tcclaviger vLLM fork → FreeToken (PR #587 ROCm) on
|
||||
dankserver.** Built FreeToken at PR head `77a7201` on the host into the
|
||||
|
||||
Reference in New Issue
Block a user