docs: frank-large halogen runbook, AGENTS.md + indices for the swap
New runbook frank-large-halogen27b-dflash2.md; LLM + vault indices re-pointed, ROCmFPX q6agent runbook marked RETIRED (rollback target); AGENTS.md topology row, detail section, image-capability paragraph (two endpoints accept images now), bench-law prose and runbook index updated.
This commit is contained in:
1 parent
fece3ffdd0
commit
0900551317
5 files changed
+219
-102
No files matched your search
@@ -213,8 +213,16 @@ The LLM inference fleet on the two hosts. Full index:
|
||||
agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix (87.06 GiB,
|
||||
Q4_0_ROCMFP4_FAST) + own MTP draft, build-qwen38 (retired 2026-08-30;
|
||||
rollback record)
|
||||
- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — the ACTIVE frank-large
|
||||
runbook since 2026-10-03 (root systemd unit, port 7770): the pinned
|
||||
- [[frank-large-halogen27b-dflash2]] — the ACTIVE frank-large runbook since
|
||||
2026-10-05 (root systemd unit + podman, port 7770): the digest-pinned
|
||||
ghcr.io/peonist-ai/halogen image serving peonist-ai/halogen-qwen3.8-27b
|
||||
(qwen3.8-27b-p1w4d-d2.hgn, 33.4 GiB — a .hgn that loads in no other
|
||||
engine) with the DFlash2 drafter on ONE slot of 200,700 ctx (slots>1
|
||||
disables speculation — engine law); TEXT-ONLY and censored base, both
|
||||
accepted tradeoffs; no server-side sampler, so the thinking recipe rides
|
||||
the wire
|
||||
- [[frank-large-rocmfpx-q6agent-uncensored-mtp]] — RETIRED 2026-10-03 → 10-05
|
||||
(rollback target; payload, fork build and build script on disk): the pinned
|
||||
kingjones30/ROCmFPX fork (scripts/build-rocmfpx.sh) serving kingjones777/
|
||||
Qwen3.8-27B-Uncensored-ROCmFP4-STRIX-MTP-GGUF
|
||||
**Qwen3.8-27B-Uncensored-Q6_0_ROCMFPX_AGENT** — ftype 114, 339 tensors of
|
||||
|
||||
Reference in new issue
Block a user