frank-default-large: cap CTX_SIZE at 131072 — 262144 OOMs SVM pool (cudaMalloc 103176 MiB failed with fully GPU-resident 87 GiB model)

serverAppConfigs-docs/LLM/agentionai-fast-imatrix.md

@@ -89,7 +89,7 @@ llama-server \
   --host 0.0.0.0 --port 7770 --jinja \
   --device ROCm0 --gpu-layers 999 \
   --split-mode none --fit off --flash-attn off \
-  --ctx-size 262144 --parallel 1 \
+  --ctx-size 131072 --parallel 1 \
   --batch-size 4096 --ubatch-size 4096 \
   --cache-type-k f16 --cache-type-v f16 \
   --threads 16 --threads-batch 16 \
@@ -119,8 +119,12 @@ Key choices and deviations from the CIRU deployment:
   mask and aborts graph build (`GGML_ASSERT(a->type == GGML_TYPE_F32)`,
   ggml.c:5371, backtrace through `build_attn_qsa`). Verified live on this
   v2 main — loads and serves fine with fa off.
-- Context kept at 262144 × 1 slot (same as the CIRU deployment; the author's
-  quick-start is 32768 but the full window is fine on SVM).
+- Context capped at 131072 × 1 slot. The 262144 window does NOT fit: the
+  fully GPU-resident 87 GiB model plus a 262144-token f16 KV cache plus the
+  worst-case compute buffer exceeds the Strix Halo SVM pool (verified live:
+  `cudaMalloc 103176 MiB failed: out of memory` on first graph alloc at
+  262144). 131072 is the proven STRIX-family value on this box. (The author's
+  quick-start is 32768 — the full 131K is comfortable.)
 - MTP is disabled (ngram-mod only) — see the MTP section below.
 
 ## MTP draft head — INCOMPATIBLE on build-qwen38