frank-default-large: verify v2 main on build-qwen38 — flash-attn off required, MTP draft incompatible (ngram-mod fallback)

- Main model (v2 joined PLE layout, sha256 1e4160ca…) loads and serves on
  build-qwen38 only with --flash-attn off: the QSA indexer path calls
  ggml_fill on the F16-cast kq mask and aborts graph build (GGML_ASSERT
  F32 at ggml.c:5371). Verified live: model loaded, health 200, real
  completion.
- MTP draft head (agentionai FAST, 2.28 GiB) does not load on this binary:
  qwen4exp loader requires full per-layer blk.<il>.hc_attn_norm.weight,
  head carries only blk.48. Third confirmation (EasiiX Q8_0 + agentionai
  FAST vs kingjones STRIX_LEAN previously, now own-matched pair). Spec
  decoding runs ngram-mod only; head retained for a future compatible build.
- FLASH_ATTN=off and SPEC_TYPE=ngram-mod wired through env + serve script;
  runbook and AGENTS.md updated with the verified constraints.

AGENTS.md

@@ -27,7 +27,7 @@ host.
 | Target | Runtime | Service | Model | Port |
 |--------|---------|---------|-------|------|
 | Dankserver | llama.cpp (upstream b10121) | frank-default-small | HauhauCS Qwen3.6-35B-A3B-Uncensored-Aggressive Q6_K_P + ngram-mod, 36 MoE experts on CPU | 7770 |
-| Dankclaw | charlie12345/ROCmFPX llama.cpp (build-qwen38) | frank-default-large | agentionai Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix (87 GiB Q4_0_ROCMFP4_FAST, per-head PLE in GGUF) + own MTP draft head (ROCmFP4-FAST), 262K context / 1 slot, reasoning on | 7770 |
+| Dankclaw | charlie12345/ROCmFPX llama.cpp (build-qwen38) | frank-default-large | agentionai Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix (87 GiB Q4_0_ROCMFP4_FAST, PLE joined table in v2 GGUF), ngram-mod spec (MTP head on disk, incompatible with this build), 262K context / 1 slot, reasoning on | 7770 |
 
 History: the 2026-08-17 redo retired the pipeline-parallel split and the
 FastFlowLM NPU endpoint. The 2026-08-18 swap retired the vLLM service on
@@ -285,23 +285,29 @@ charlie12345/ROCmFPX `llama-server` built at
 merged). The model is a 56B MoE (512 experts, 10 used), 48 layers (12 attn +
 36 SSM, full_attention_interval=4), QSA indexer (4 heads, top_k=2048),
 hyper-connections (count=4, low_rank=320), PLE (layer 1). The 51.2 B-parameter
-n-gram table is split per head INSIDE the single GGUF — fully VRAM-resident,
-no sidecar, no `--ngram-on-disk`. The model's own MTP draft head
+n-gram table is a single joined tensor in the `v2/` GGUF we serve (the root
+`-ple16` per-head split requires the LaurentZuijdwijk Vulkan fork and aborts
+this loader's `GGML_ASSERT(qwen4exp is missing the PLE n-gram table)`) — fully
+VRAM-resident, no sidecar, no `--ngram-on-disk`. The model's own MTP draft head
 (`agentionai/Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST-GGUF`, 2.28 GiB, ROCmFP4-FAST
-quant matched to target, ~66% draft acceptance) drives speculative decoding
-at depth 3; vision tower (f16) ships as mmproj/. It runs 262144 context / 1
+quant matched to target) is on disk but does **not** load on this binary
+(loader requires a full per-layer `blk.<il>.hc_attn_norm.weight` set; the head
+carries only `blk.48`) — speculative decoding runs ngram-mod only. Vision
+tower (f16) ships as mmproj/. It runs 262144 context / 1
 slot, b 4096 / ub 4096, t 16 / tb 16, f16 KV cache, `--fit off` (auto-fit
-segfaults on qwen4exp hyper-connection config), and reasoning on (Sharp
+segfaults on qwen4exp hyper-connection config), `--flash-attn off` (required:
+fa on aborts graph build on the QSA indexer path — F32 `ggml_fill` on the F16
+kq mask, ggml.c:5371), and reasoning on (Sharp
 template, budget -1, `--reasoning-format deepseek`; chat kwargs keep
 `preserve_thinking` + `preserve_reasoning`). Env
 `scripts/frank-default-large.env`, serve `scripts/serve-frank-large.sh`.
 
 **Serving status (2026-08-29):** deployed the agentionai ROCmFP4-FAST imatrix
-model with its own matched MTP draft head, replacing the jcbtc CIRU v1.1
-deployment (ciru-ai runtime). The 2026-08-28 failure of this head on the
-kingjones STRIX_LEAN model (`missing tensor blk.0.hc_attn_norm.weight`) was a
-cross-vendor pairing problem — the head carries the hyper-connection norm
-tensor (`blk.48.hc_attn_norm.weight`) and works against its own main file.
+model (v2 joined PLE layout), replacing the kingjones STRIX and jcbtc CIRU v1.1
+deployments. The own-matched MTP draft head does NOT load on build-qwen38 —
+verified against the v2 main itself (`missing tensor blk.0.hc_attn_norm.weight`),
+third confirmation (EasiiX Q8_0 + agentionai FAST vs STRIX_LEAN earlier). The
+head stays on disk for a future compatible binary.
 Runbook:
 [serverAppConfigs-docs/LLM/agentionai-fast-imatrix.md](serverAppConfigs-docs/LLM/agentionai-fast-imatrix.md).