frank-large: cutover to flash-server v2 (abliterated Swift1.5)
Engine: halogen-flash-server 0.16.2, digest-pinned (pulled 0c61bf84). Payload: Quat3rnion qwen38-flash-next-v2-swift15-abliterated.hgn (66,687,678,464 B, sha256-verified) + REQUIRED n-gram table (51,200,246,144 B @peonist 5cc17cea) + vision tower (897,916,416 B @peonist e053f488) + shared tokenizer (6 files). Shape: 2 slots x 200192 (KV pool 400384 positions, ~10.7 GiB), MTP always-on (HALOGEN_SPEC_ADAPT=0, card-mandated), server-side sampler at the card's 1.0/0.95/20, MAX_TOK 8192 with the 65536/7200 coupled pair, vision ON. Rollback = revert this commit (27B payload stays on disk). - serve script: byte-exact gates on all three .hgn files + flat tokenizer, foreground podman run (ledger to the log file) - deploy-remote: twin gates for n-gram/vision, flashnext fetch pointer - seam: 19 tests rewritten (spec-adapt law, pool product, compaction math, render shape); full suite 362/362 green
This commit is contained in:
1 parent
7fef3cb907
commit
31b1ec397b
6 files changed
+495
-266
No files matched your search
@@ -1,5 +1,5 @@
|
||||
[Unit]
|
||||
Description=halogen container (peonist-ai/halogen-qwen3.8-27b, DFlash2 spec decode, 1 slot x 200700, text-only), root systemd unit (dankclaw, frank-large, Strix Halo iGPU)
|
||||
Description=halogen-flash-server container (Quat3rnion abliterated Swift1.5 of Qwen3.8-Flash-Next v2, MTP spec decode, 2 slots x 200192, vision ON), root systemd unit (dankclaw, frank-large, Strix Halo iGPU)
|
||||
After=network-online.target
|
||||
Wants=network-online.target
|
||||
|
||||
@@ -22,7 +22,7 @@ TimeoutStopSec=120
|
||||
# would otherwise leave the endpoint down until someone notices.
|
||||
Restart=always
|
||||
RestartSec=10
|
||||
# The engine mmaps 33.4 GiB of weights and keeps a multi-GiB working set
|
||||
# The engine pins ~62 GiB of v2 weights and keeps a multi-GiB working set
|
||||
# on a box that also hosts frank-small, ComfyUI and the Caddy/observability
|
||||
# stack; make it a late OOM candidate, not the first.
|
||||
OOMScoreAdjust=-500
|
||||
|
||||
Reference in new issue
Block a user