frank-large: CIRU v4.4.1 Orca cutover — root unit, one stream, full context

Operator call 2026-09-19: switch the iGPU endpoint from
halogen-flash-server to jcbtc/Qwen3.8-Flash-CIRU-STRIX-Orca on the CIRU
v4.4.1 runtime with the QSA window hotfix (host build against the private
ROCm 10 SDK), one stream of the full 262144 trained window.  The service
leaves the quadlet shape for a root unit (the same shape as frank-small and
frank-medium: a private-SDK host binary has no image to install and no
generated unit to dodge); the halogen quadlet is archived, the deploy
handler retires it on the host, gates on 7770, and its stray-run sweep
matches the model path so it cannot take frank-small down.
This commit is contained in:
Frank committed 2026-09-19 02:59:01 -07:00
1 parent d374ab963f
commit b6ce3afb1f
9 files changed
+317 -406

No files matched your search

+21
View File
@@ -0,0 +1,21 @@
[Unit]
Description=CIRU v4.4.1 Orca Qwen3.8-Flash (dankclaw, frank-large, Strix Halo iGPU gfx1151)
After=network-online.target
Wants=network-online.target
[Service]
Type=simple
User=dank
Group=dank
# The engine pins staging buffers and the PLE pager's hot window; keep the
# memlock budget unbounded so an RLIMIT smaller than the pinned set cannot
# fail the load. Parity with the halogen quadlet's Ulimit=memlock=-1:-1 and
# the other LLM units on this fleet.
LimitMEMLOCK=infinity
Environment="FRANK_LARGE_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-large.env"
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-large.sh
Restart=on-failure
RestartSec=10
[Install]
WantedBy=multi-user.target