docs: record fleet double swap (large -> kingjones STRIX on pinned fork, small -> Huihui FP8 on FreeToken)

- kingjones-strix-rocmfp4 reactivated as the ACTIVE large runbook:
  runtime build recipe (WEBUI=OFF gotcha), deployed serving profile,
  fa-on-works-unpatched evidence, MTP heads documented unloadable,
  swap procedure + 2026-08-30 validation record
- agentionai-fast-imatrix marked RETIRED (rollback record kept)
- freetoken-frank-default-small: model/lineage/template sections now
  Huihui abliterated FP8; new operational quirk: chat API 422 without
  explicit model field
- LLM index + AGENTS fleet table/runtime sections current; both
  services' history chains fixed (small was still Tiel in AGENTS.md)
- worklog entry added; models.json contextWindow for large corrected
  to the real per-slot 131072 (llama clamps n_ctx_train/parallel)

serverAppConfigs-docs/LLM/freetoken-frank-default-small.md

@@ -1,7 +1,7 @@
 ---
 type: configuration
 title: FreeToken frank-default-small Runbook
-description: FreeToken v0.1.2 serving Qwen3.6-35B-A3B-FP8 as frank-default-small on Dankserver (RTX 3090).
+description: FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8 as frank-default-small on Dankserver (RTX 3090).
 tags:
   - freetoken
   - dankserver
@@ -9,32 +9,40 @@ tags:
   - qwen3.6
   - moe
   - fp8
-timestamp: 2026-09-02
+timestamp: 2026-08-30
 ---
 
 # FreeToken frank-default-small Runbook
 
 The `frank-default-small` service on Dankserver is served by
 **FreeToken v0.1.2** — an edge-native MoE serving engine that keeps
-expert weights in host RAM with an LRU GPU cache. It replaced the
-llama.cpp Tiel-Coder-35B-A3B (UD-Q6_K_XL) deployment on 2026-09-02.
+expert weights in host RAM with an LRU GPU cache. Model history on this
+runtime: official `Qwen/Qwen3.6-35B-A3B-FP8` (since 2026-09-02) →
+`batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8` (2026-08-30,
+same format and pool budget). The engine itself replaced the llama.cpp
+Tiel-Coder-35B-A3B (UD-Q6_K_XL) deployment.
 
 ## Model
 
 | Field | Value |
 |-------|-------|
-| HuggingFace | `Qwen/Qwen3.6-35B-A3B-FP8` |
+| HuggingFace | `batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8` |
+| Lineage | Qwen/Qwen3.6-35B-A3B → huihui-ai abliterated → this FP8 (quantizer batsclamp) |
 | Architecture | `qwen3_5_moe` (Qwen3_5MoeForConditionalGeneration) |
-| Quant | modelopt block-fp8 (128×128 `weight_block_size`) |
-| Size on disk | 35 GB |
-| Path | `/home/dank/models/qwen36-35b-a3b-fp8` |
+| Quant | native modelopt block-fp8 e4m3, dynamic activations, 128×128 `weight_block_size`, bf16 `weight_scale_inv` — byte-format identical to the official FP8 repo |
+| BF16 kept | lm_head, embed_tokens, all norms, router gates, mamba state params, visual encoder, MTP module |
+| Experts | un-fused per-expert layout (`mlp.experts.{0..255}.*`) matching official Qwen FP8 — same FreeToken loader path |
+| Size on disk | ~35 GB (26 safetensors shards) |
+| Path | `/home/dank/models/huihui-qwen36-35b-a3b-abliterated-fp8` |
 | Layers | 40 (10 full-attention + 30 GDN/linear-attention) |
 | Experts | 256 per layer, 8 used per token |
 | KV heads | 2 × 256 dim |
 | Context | 262,144 (model max) |
+| Chat template | froggeric/Qwen-Fixed-Chat-Templates (fixed Qwen3.6 template, shipped in `tokenizer_config.json`; FreeToken reads it from the checkpoint — no override) |
 
-**Important:** This serves base Qwen3.6-35B-A3B weights, not the
-Tiel-Coder finetune that was previously served via llama.cpp.
+**Important:** this is the Huihui *abliterated* finetune (refusals
+removed) — not the base Qwen weights served before 2026-08-30, and not
+the earlier Tiel-Coder finetune. Expect a direct-answers assistant.
 
 ## Runtime
 
@@ -71,7 +79,7 @@ ft ctl --base-url http://127.0.0.1:7770 cache --kv N --moe M --wait 300
 - The fit check refuses overcommit: if the plan doesn't fit, the old
   cache is retained and serving continues.
 
-### Benchmark Results (2026-09-02)
+### Benchmark Results (2026-09-02, base FP8 checkpoint)
 
 See [[freetoken-benchmark-sweep]] for the full bs1/bs3/bs4/bs6 sweep
 across KV pool sizes 8k–700k.
@@ -110,7 +118,7 @@ FreeToken v0.1.2 supports these safetensor quants for `qwen3_5_moe`:
 
 ## Limitations
 
-- **Model identity**: serves base Qwen3.6-35B-A3B, not Tiel-Coder finetune.
+- **Model identity**: serves the Huihui abliterated FP8 finetune, not the Tiel-Coder coder finetune from the llama.cpp era.
 - **JIT compilation**: first startup compiles flashinfer/tvm-ffi kernels
   (~5–15 min cold). Cached afterward in `~/.cache/flashinfer` and
   `~/.cache/tvm-ffi`.
@@ -120,8 +128,21 @@ FreeToken v0.1.2 supports these safetensor quants for `qwen3_5_moe`:
 - **Env var collisions**: never name tunables `TEMP`, `HOST`, or
   `GPU_MAX_HEAP_SIZE` (HIP runtime reads these).
 
+## Operational quirks
+
+- **`model` field is required** in `/v1/chat/completions` bodies —
+  FreeToken rejects requests without it with a 422 (`Field required`),
+  unlike llama.cpp's server which defaults to the loaded model. Send
+  `"model": "frank-default-small"`.
+- Load on this swap took well under the old llama.cpp numbers:
+  weights → experts (parallel build) → CUDA graph capture → Uvicorn
+  in ~2 minutes; the 2026-08-30 swap verified ~40 tok/s decode on a
+  282-token completion.
+
 ## Citations
 
 - FreeToken paper: arXiv 2608.16157
 - FreeToken PyPI: `freetoken[accel]` v0.1.2
-- HuggingFace model: `Qwen/Qwen3.6-35B-A3B-FP8`
+- HuggingFace model: `batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8`
+- Upstream weights: `huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated`, `Qwen/Qwen3.6-35B-A3B-FP8`
+- Fixed chat template: `froggeric/Qwen-Fixed-Chat-Templates`