dank/serverAppConfigs
1
0
Fork 0
Code Issues 4 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

frank-default-large: 200000 context per slot (400000 total, 2 slots)

Browse Source 
User request 2026-08-19: lower per-stream context from 262144 to 200000.
CTX_SIZE is the total; llama.cpp splits it across the 2 parallel slots.
f16 KV drops from ~32 GiB to ~24 GiB, adding OOM headroom.

Docs: sync the 2026-08-18 service swap (frank-default-large on dankclaw,
frank-default-small on dankserver) across AGENTS.md, README.md,
deployment.md, ciru-activefpx-promptforge.md, and index.md. The pi
models.json contextWindow/maxTokens for frank-default-large move
262144 -> 200000 (separate file, outside the repo).
This commit is contained in:
Frank
2026-08-19 10:38:53 -07:00
parent 9fd82dc6e1
commit 8e4d63b68d
6 changed files with 32 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/index.md
+1 -1
View File
@@ -22,7 +22,7 @@ ngram-mod, 36 MoE experts on CPU, 700K ctx]
E[CIRU ROCmFPX llama.cpp
frank-default-large, port 52625]
F[jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge
256K ctx / 2 slots, native MTP, PromptForge DualView]
200K ctx / 2 slots, native MTP, PromptForge DualView]
D --> E --> F
end