dank/serverAppConfigs
1
0
Fork 0
Code Issues 4 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

frank-default-large: 200000 context per slot (400000 total, 2 slots)

Browse Source 
User request 2026-08-19: lower per-stream context from 262144 to 200000.
CTX_SIZE is the total; llama.cpp splits it across the 2 parallel slots.
f16 KV drops from ~32 GiB to ~24 GiB, adding OOM headroom.

Docs: sync the 2026-08-18 service swap (frank-default-large on dankclaw,
frank-default-small on dankserver) across AGENTS.md, README.md,
deployment.md, ciru-activefpx-promptforge.md, and index.md. The pi
models.json contextWindow/maxTokens for frank-default-large move
262144 -> 200000 (separate file, outside the repo).
This commit is contained in:
Frank
2026-08-19 10:38:53 -07:00
parent 9fd82dc6e1
commit 8e4d63b68d
6 changed files with 32 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files
AGENTS.md
+3 -3
View File
@@ -8,7 +8,7 @@ local machines. Topology (2026-08-18):
| Target | Host | Runtime | Service | Model | Port |
|--------|------|---------|---------|-------|------|
| Dankserver | dank@dankserver | llama.cpp (upstream b10121) | frank-default-small | HauhauCS Qwen3.6-35B-A3B-Uncensored-Aggressive Q6_K_P + ngram-mod, 36 MoE experts on CPU | 7770 |
| Dankclaw | dank@dankclaw | CIRU ROCmFPX llama.cpp (ROCm 7.15 SDK in the ling3-ciru venv) | frank-default-large | jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2, native MTP, PromptForge DualView, 256K context / 2 slots | 52625 |
| Dankclaw | dank@dankclaw | CIRU ROCmFPX llama.cpp (ROCm 7.15 SDK in the ling3-ciru venv) | frank-default-large | jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge v2, native MTP, PromptForge DualView, 200K context / 2 slots | 52625 |
The 2026-08-17 redo retired the pipeline-parallel split and the FastFlowLM
NPU endpoint. The 2026-08-18 swap retired the vLLM service on Dankclaw; the
@@ -16,7 +16,7 @@ CIRU ROCmFPX llama.cpp runtime now runs on the Strix Halo iGPU (gfx1151).
A second 2026-08-18 swap renamed the services and restored the Qwen3.6 35B
A3B Q6_K_P model on Dankserver: Dankserver is now `frank-default-small`
(Qwen3.6-35B-A3B Q6_K_P + ngram-mod, MoE experts on CPU) and Dankclaw is
now `frank-default-large` (CIRU Qwen3.8-27B, 256K context / 2 slots). The
now `frank-default-large` (CIRU Qwen3.8-27B, 200K context / 2 slots). The
retired Qwen3.8-27B IQ4_XS FastMTP files live in `.AGENTTRASH/`. See
docs/ciru-activefpx-promptforge.md. The old scripts live in `old/scripts/`
for reference; they describe the retired PP topology.
@@ -105,7 +105,7 @@ When you rename a service or move a model to a new host, update
`models.json`. Update the provider key, the model `id`, `contextWindow`, and
`input`. If the default model moved hosts, also update `defaultProvider` in
`settings.json`. Set `contextWindow` to the per-slot context (dankserver
`175104`, dankclaw `262144`). The full schema is in the agent knowledge base
`175104`, dankclaw `200000`). The full schema is in the agent knowledge base
page `~/.pi/agent/docs/pi/models.md`.
## Runtime & Troubleshooting