docs: frank-secondary at 2x114688/ubatch 1024 — runbook renamed + rewritten, fleet docs updated
- runbook git mv ...-mtp-131072.md -> ...-mtp-114688.md; new Measured section (22,374 used / 1,751 MiB free, decode 58.2/66.9 t/s, confounded vs 2x131072 noted), rollback ladder, trail entry - AGENTS.md: topology row, ACTIVE section, contextWindow 114688, runbook index; mmproj name corrected to the publisher's mmproj-BF16.gguf - LLM/index.md, index.md, mimo runbook link, log.md entry + path fix
This commit is contained in:
1 parent
f2575a1018
commit
44e7a8dfaf
6 files changed
+164
-91
No files matched your search
@@ -2,6 +2,26 @@
|
||||
|
||||
|
||||
## 2026-10-06
|
||||
- **frank-secondary (Dankclaw): RENAMED from frank-small, then reshaped
|
||||
to 2×114,688 / ubatch 1024 (llama.cpp, RTX 3090).** The rename (commit
|
||||
87721ab, 87 files: serve trio, unit, bats seam, 9 runbooks, identifiers
|
||||
`FRANK_SECONDARY_*`/`llm_secondary`/`deploy_llm_secondary`; historical
|
||||
refs to the OLD FreeToken/CUDA frank-small and to the Dankserver
|
||||
service that became frank-medium stay frank-small, as does
|
||||
`freetoken-frank-small.md`). Live unit transition by hand before the
|
||||
deploy: `systemctl stop frank-small` + `systemctl disable frank-small`
|
||||
(a relinked unit — disable removes only its stale symlink) →
|
||||
`deploy.sh dankclaw --service frank-secondary`. The reshape (commit
|
||||
f2575a1, Frank's order "lower max context to 112k so we can increase
|
||||
ubatch to at least 1k"): `CTX_SIZE 262144→229376` (per-slot
|
||||
131,072→114,688), `UBATCH_SIZE 512→1024` → **22,374 used / 1,751 MiB
|
||||
free** (the per-slot cut frees ~1.05 GiB of KV; ubatch 1024 spends
|
||||
part, netting ~1.25 GiB back over the 489 MiB fit), decode 58.2 t/s
|
||||
recipe / 66.9 temp 0 (acceptance 42.8–54.4 % — the drop vs the prior
|
||||
boot's 63.3/72.9 is confounded by prompt text, not a shape verdict).
|
||||
Harness retargeted: models.yml (id/name/compactionModels,
|
||||
`contextWindow: 114688`) + config.yml modelRoles ×14. Runbook renamed:
|
||||
`serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688.md`.
|
||||
- **frank-secondary (Dankclaw): two Swift-1.5-27B reshapes (llama.cpp, RTX 3090).**
|
||||
Morning: Frank's order "drop mtp, skip ngram, ubatch 512, two 128k
|
||||
contexts" → 2×131,072 no-spec on the IQ3_S-mtp (commit 812d9eb):
|
||||
@@ -19,7 +39,7 @@
|
||||
uncensored model thinks more — 64 tokens is all `reasoning_content`).
|
||||
ngram-mod still skipped (recurrent-state rollback law on the qwen35
|
||||
hybrid). Runbook renamed + rewritten:
|
||||
`serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-131072.md`.
|
||||
`serverAppConfigs-docs/LLM/frank-secondary-llama-swift15-unc-iq3xxs-mtp-114688.md`.
|
||||
- **frank-large (Dankclaw): halogen 27B-dense → halogen-flash-server
|
||||
0.16.2 v2 Swift1.5 ABLITERATED (Strix Halo iGPU, port 7770).** Cutover
|
||||
commit 31b1ec3 (03:07:40): the v2 `.hgn` payload loads ONLY in the
|
||||
|
||||
Reference in new issue
Block a user