frank-default-small: run on ik_llama.cpp with q8_KV + Hadamard cache

Switch frank-default-small on Dankserver from upstream llama.cpp (b10121)
to ikawrakow/ik_llama.cpp (b166e269, built with the staged pip cu13
toolkit). The model (Ornith-1.5-35B-A3B CRACK Q6_K) is unchanged and the
old binary is kept for rollback.

Runtime changes:
- KV cache quantized to q8_KV with --k-cache-hadamard/--v-cache-hadamard
- --split-mode graph (single-GPU no-op, retained per operator pref)
- migrate ngram speculation to canonical
  --spec-type ngram-mod:n_min=48,n_max=64,ngram_size_n=24
  (legacy --spec-ngram-mod-* are rejected in ik main)
- N_GPU_LAYERS 999 (ik -ngl rejects the literal "all"); experts stay
  pinned to CPU via --override-tensor

Build: GGML_CUDA_FA_ALL_QUANTS=ON + GGML_IQK_FA_ALL_QUANTS=ON mandatory
for the quantized KV cache; recipe + reasoning baked into
docs/LLM/ikllama-ornith.md. Tests and both indices updated.

scripts/serve-frank-small.sh

@@ -1,11 +1,19 @@
 #!/usr/bin/env bash
 # Serve dealignai/Ornith-1.5-35B-A3B-UNCENSORED (CRACK, Q6_K) as
-# frank-default-small via upstream llama.cpp on Dankserver (RTX 3090, MoE
+# frank-default-small via ik_llama.cpp on Dankserver (RTX 3090, MoE
 # experts on CPU).
 #
-# Runtime: upstream llama.cpp llama-server (b10121). The model is a 35B-total /
-# 3B-active MoE-dense hybrid with an MTP head bundled in the GGUF; this
-# service uses ngram-mod instead of MTP speculation.
+# Runtime: ik_llama.cpp llama-server (ikawrakow ik_llama.cpp). The model is a
+# 35B-total / 3B-active MoE-dense hybrid with an MTP head bundled in the GGUF;
+# this service uses ngram-mod instead of MTP speculation.
+#
+# KV cache: q8_KV with Hadamard transforms on K and V (requires a build with
+# GGML_CUDA_FA_ALL_QUANTS=ON + GGML_IQK_FA_ALL_QUANTS=ON; see the env file).
+#
+# Split mode graph + --override-tensor CPU expert offload. Per ik_llama
+# README, `--split-mode graph` + partial GPU offload can occasionally produce
+# incoherent output; the documented fallback is `-cuda graphs=0`. Smoke-test
+# after each model load.
 #
 # Expert offload: the expert (FFN exps) tensors selected by the layer-bounded
 # --override-tensor pattern are pinned to CPU. Selected full-attention and
@@ -38,19 +46,19 @@ fi
 : "${LISTEN_PORT:=7770}"
 : "${CTX_SIZE:=491520}"
 : "${PARALLEL:=3}"
-: "${SPEC_TYPE:=ngram-mod}"
-: "${SPEC_NGRAM_MOD_N_MIN:=48}"
-: "${SPEC_NGRAM_MOD_N_MAX:=64}"
-: "${SPEC_NGRAM_MOD_N_MATCH:=24}"
+: "${SPEC_TYPE:=ngram-mod:n_min=48,n_max=64,ngram_size_n=24}"
 : "${CACHE_TYPE_K:=f16}"
 : "${CACHE_TYPE_V:=f16}"
+: "${K_CACHE_HADAMARD:=0}"
+: "${V_CACHE_HADAMARD:=0}"
+: "${SPLIT_MODE:=none}"
 : "${VERBOSITY:=4}"
 # Expert offload: --override-tensor regex pinned to the CPU buft. Same pattern
 # the internal --cpu-moe / --n-cpu-moe use; explicit here so we only move the
 # MoE expert weights and leave every other tensor on the GPU.
 : "${OVERRIDE_EXPERT:=blk\.(0|1|2|4|5|6|8|9|10|12|13|14|16|17|18|20|21|22|24|25|26|28|29|30|32|33|34)\.ffn_(up|down|gate|gate_up)_(ch|)exps}"
 : "${OVERRIDE_BUFT:=CPU}"
-: "${N_GPU_LAYERS:=all}"
+: "${N_GPU_LAYERS:=999}"
 : "${BATCH_SIZE:=4096}"
 : "${UBATCH_SIZE:=1024}"
 : "${CTX_CHECKPOINTS:=16}"
@@ -81,12 +89,12 @@ exec "$LLAMA_SERVER" \
     --mmproj "$MMPROJ" \
     --chat-template-file "$CHAT_TEMPLATE_FILE" \
     --spec-type "$SPEC_TYPE" \
-    --spec-ngram-mod-n-min "$SPEC_NGRAM_MOD_N_MIN" \
-    --spec-ngram-mod-n-max "$SPEC_NGRAM_MOD_N_MAX" \
-    --spec-ngram-mod-n-match "$SPEC_NGRAM_MOD_N_MATCH" \
     --override-tensor "$OVERRIDE_EXPERT=$OVERRIDE_BUFT" \
     --cache-type-k "$CACHE_TYPE_K" \
     --cache-type-v "$CACHE_TYPE_V" \
+    $([ "$K_CACHE_HADAMARD" = "1" ] && printf -- "--k-cache-hadamard") \
+    $([ "$V_CACHE_HADAMARD" = "1" ] && printf -- "--v-cache-hadamard") \
+    --split-mode "$SPLIT_MODE" \
     --verbosity "$VERBOSITY" \
     --ctx-size "$CTX_SIZE" \
     --parallel "$PARALLEL" \