frank-default-large: full 262144 context, 1 slot
User request 2026-08-19 (second pass): parallel slots degraded performance. PARALLEL=1, CTX_SIZE=262144 (native max, -c equals the per-slot context with one slot). Concurrent requests queue on the single slot; the server never preempts a running generation. pi models.json contextWindow/maxTokens back to 262144 (outside repo). Docs updated to match.
This commit is contained in:
1 parent
8e4d63b68d
commit
048e7eaaba
6 files changed
+22
-20
No files matched your search
+1
-1
@@ -22,7 +22,7 @@ ngram-mod, 36 MoE experts on CPU, 700K ctx]
|
||||
E[CIRU ROCmFPX llama.cpp
|
||||
frank-default-large, port 52625]
|
||||
F[jcbtc Qwen3.8-27B-CIRU-ActiveFPX-PromptForge
|
||||
200K ctx / 2 slots, native MTP, PromptForge DualView]
|
||||
262K ctx / 1 slot, native MTP, PromptForge DualView]
|
||||
D --> E --> F
|
||||
end
|
||||
|
||||
|
||||
Reference in new issue
Block a user