docs(frank-dragoon): native-era runbook; retire the swift15 page
New LLM/frank-dragoon-flash-server-v2-native.md carries the shape with the three deliberate deviations from the card (served id, SPEC_ADAPT=0, engine pin 0.16.2), the memory ledger with the PIN_TRUNK rejection, the full measured A/B table, and the companion law (hardlinked stock peonist files, engine-tool certified). The swift15 page is re-banned RETIRED 2026-10-06 → 10-17 with its rollback terms; both indexes and AGENTS.md (topology table, service section, runbook index) are re-keyed, and the root index also stops describing the halogen-27B page as ACTIVE.
This commit is contained in:
1 parent
e36f6a732c
commit
13162e6615
5 files changed
+294
-69
No files matched your search
@@ -16,10 +16,10 @@ disk); tags frank-archon-freetoken-pr587-20261005 and
|
||||
frank-archon-vllm-shapeG-20261003),
|
||||
and Dankclaw runs two endpoints — **halogen-flash-server 0.16.2
|
||||
(frank-dragoon, port 7770: ghcr.io/peonist-ai/halogen-flash-server @ pinned
|
||||
digest serving the Quat3rnion ABLITERATED Swift1.5 finetune of
|
||||
Qwen3.8-Flash-Next v2, a ~62 GiB v2 .hgn that loads in no other engine,
|
||||
MTP spec decode always-on (HALOGEN_SPEC_ADAPT=0), TWO slots at 200,192
|
||||
ctx, vision ON)** and
|
||||
digest serving the NATIVE v2 conversion of the abliterated
|
||||
Qwen3.8-Flash-Next, a ~62 GiB v2 .hgn that loads in no other engine,
|
||||
MTP spec decode always-on (HALOGEN_SPEC_ADAPT=0), TWO slots over ONE
|
||||
262,144-position KV pool, vision ON)** and
|
||||
**llama.cpp on the PrismML fork (frank-zealot, port 7771: prism-ml
|
||||
Ternary-Bonsai-2-27B at **PQ2_0** — 27B qwen35 hybrid (16 full-attention + 48
|
||||
Gated DeltaNet layers), TWO 200,704-token conversations, MTP disabled,
|
||||
@@ -53,12 +53,12 @@ PLE 47.7 GiB pinned RAM, fp8 KV 7.32 KiB/tok, MTP depth 2,
|
||||
gfx1151 iGPU 114 GiB GTT]
|
||||
E[flash-server container gfx1151, digest-pinned image
|
||||
frank-dragoon, port 7770]
|
||||
F[flash-server v2 abliterated Swift1.5 .hgn + ngram table + vision tower
|
||||
2 x 200192 ctx, MTP always-on, image input]
|
||||
G[llama.cpp master CUDA sm_86
|
||||
F[flash-server v2 native abliterated .hgn + ngram table + vision tower
|
||||
ONE 262144-position KV pool, 2 slots, MTP always-on, image input]
|
||||
G[llama.cpp PrismML fork CUDA build
|
||||
frank-zealot, port 7771]
|
||||
H[Gemma4-26B-A4B QAT Uncensored Q4_K_M GGUF
|
||||
1 x 200704 ctx, q8_0 K + q8_0 V, MTP off, mmproj vision]
|
||||
H[Ternary-Bonsai-2-27B PQ2_0 GGUF + Q8_0 mmproj
|
||||
2 x 200704 ctx, q8_0 K + q8_0 V, MTP off, mmproj vision]
|
||||
E2 --> E --> F
|
||||
E2 --> G --> H
|
||||
end
|
||||
@@ -77,23 +77,31 @@ frank-zealot, port 7771]
|
||||
|
||||
## Active Deployment
|
||||
|
||||
- [[frank-dragoon-flash-server-v2-swift15]] — **ACTIVE since 2026-10-06**
|
||||
- [[frank-dragoon-flash-server-v2-native]] — **ACTIVE since 2026-10-17**
|
||||
(root systemd unit + podman, port 7770): the digest-pinned
|
||||
`ghcr.io/peonist-ai/halogen-flash-server` 0.16.2 engine serving the
|
||||
Quat3rnion ABLITERATED Swift1.5 finetune of peonist's
|
||||
Qwen3.8-Flash-Next v2 checkpoint (`qwen38-flash-next-v2-swift15-abliterated.hgn`,
|
||||
66.7 GB compacted r2 of the card's 89.8 GB append-only original,
|
||||
sha256-verified) with the REQUIRED n-gram lookup table (51.2 GB,
|
||||
@peonist 5cc17cea) and the vision tower (897.9 MB, @e053f488) beside
|
||||
it. TWO slots of 200,192 ctx, MTP head ALWAYS ON (`HALOGEN_SPEC_ADAPT=0`
|
||||
— the adaptive default turns the head off per request and halves
|
||||
decode), server-side sampler at the card's 1.0/0.95/20, coupled
|
||||
cap/timeout 65536/7200, prompt cache ON by default (the 27B engine's
|
||||
manual `HALOGEN_CACHE_MB` pin era is over — warm 100k turn ≈ 2 s vs
|
||||
≈ 88 s cold). Vision ON (image_url parts only). Card: 53-57 t/s
|
||||
greedy, ~1,640 t/s prefill at 34k, ~72 % fewer thinking tokens.
|
||||
Rollback: revert the swap commit; the 27B payload + fetch script stay
|
||||
on disk
|
||||
**native v2 conversion** of the abliterated Qwen3.8-Flash-Next
|
||||
(`qwen38-flash-next-v2-abliterated.hgn`, 66,687,678,432 B, Hub LFS
|
||||
sha256-verified at fetch) with the REQUIRED n-gram lookup table (51.2 GB,
|
||||
@peonist 5cc17cea) and the vision tower (897.9 MB, @e053f488)
|
||||
**hardlinked** beside it — the card publishes only the main file, and the
|
||||
engine's own tools certified the stock companions (`niah` 18/18, `ppl`
|
||||
3.968 with mean KL 0.155 against the Swift1.5 logits on the same corpus).
|
||||
Card-recommended `HALOGEN_KV_POOL_POSITIONS=262144`: **one pool behind two
|
||||
slots** — 7.2 GiB where the old shape spent 14.6, the per-request ceiling
|
||||
unchanged at 262,144, and the freed RAM becomes page cache for the n-gram
|
||||
table. MTP head always on, sampler 1.0/0.95/20, coupled cap/timeout
|
||||
65536/7200, prompt cache ON, vision ON. Measured against the Swift1.5
|
||||
boot: cold prefill +12.6 %, decode 50.0 vs 46.8 t/s, NIAH 18/18 vs 17/18,
|
||||
PPL +2.3 %, thinking tokens ×1.9 (the finetune's compression is gone).
|
||||
Rollback: revert the swap commit; the swift15 payload and its fetch script
|
||||
stay on disk
|
||||
- [[frank-dragoon-flash-server-v2-swift15]] — **RETIRED 2026-10-06 → 10-17
|
||||
(rollback target: payload + fetch script on disk)**: the Swift1.5-finetuned
|
||||
v2 `.hgn` (compacted r2, 66,687,678,464 B) at TWO slots × 200,192 ctx over
|
||||
a 524,288-position pool; owns the 400-zone law (the harness chars/4
|
||||
under-count against the engine ceiling), the MTP-always-on law, and the
|
||||
sampler / prompt-cache / vision contract the native era carries verbatim
|
||||
- [[frank-dragoon-halogen27b-dflash2]] — **RETIRED 2026-10-05 → 10-06
|
||||
(rollback target; payload + fetch script + image on disk)**: the
|
||||
digest-pinned `ghcr.io/peonist-ai/halogen` 0.1.4 engine serving
|
||||
|
||||
Reference in new issue
Block a user