frank-default-large: cap CTX_SIZE at 32768 (author quick-start) — 87 GiB fully-resident model + context buffer OOMs HIP heap (50.8 GiB at 131072, 103 GiB at 262144)

serverAppConfigs-docs/LLM/agentionai-fast-imatrix.md

@@ -89,7 +89,7 @@ llama-server \
   --host 0.0.0.0 --port 7770 --jinja \
   --device ROCm0 --gpu-layers 999 \
   --split-mode none --fit off --flash-attn off \
-  --ctx-size 131072 --parallel 1 \
+  --ctx-size 32768 --parallel 1 \
   --batch-size 4096 --ubatch-size 4096 \
   --cache-type-k f16 --cache-type-v f16 \
   --threads 16 --threads-batch 16 \
@@ -119,12 +119,13 @@ Key choices and deviations from the CIRU deployment:
   mask and aborts graph build (`GGML_ASSERT(a->type == GGML_TYPE_F32)`,
   ggml.c:5371, backtrace through `build_attn_qsa`). Verified live on this
   v2 main — loads and serves fine with fa off.
-- Context capped at 131072 × 1 slot. The 262144 window does NOT fit: the
-  fully GPU-resident 87 GiB model plus a 262144-token f16 KV cache plus the
-  worst-case compute buffer exceeds the Strix Halo SVM pool (verified live:
-  `cudaMalloc 103176 MiB failed: out of memory` on first graph alloc at
-  262144). 131072 is the proven STRIX-family value on this box. (The author's
-  quick-start is 32768 — the full 131K is comfortable.)
+- Context capped at **32768 × 1 slot — the author's own quick-start**. This
+  model is fully GPU-resident (87.06 GiB): the PLE n-gram table sits inside
+  the GGUF as one tensor, unlike STRIX_LEAN which streamed it from RAM.
+  HIP heap is 119.3 GiB; the context buffer is 50.8 GiB at 131072 and
+  103 GiB at 262144, so either window OOMs (`cudaMalloc … failed: out of
+  memory`, verified live on first graph alloc). At 32768 the buffer is
+  ~13 GiB (~100 GiB total) and loads clean.
 - MTP is disabled (ngram-mod only) — see the MTP section below.
 
 ## MTP draft head — INCOMPATIBLE on build-qwen38