Frank
b6ce3afb1f
Operator call 2026-09-19: switch the iGPU endpoint from halogen-flash-server to jcbtc/Qwen3.8-Flash-CIRU-STRIX-Orca on the CIRU v4.4.1 runtime with the QSA window hotfix (host build against the private ROCm 10 SDK), one stream of the full 262144 trained window. The service leaves the quadlet shape for a root unit (the same shape as frank-small and frank-medium: a private-SDK host binary has no image to install and no generated unit to dodge); the halogen quadlet is archived, the deploy handler retires it on the host, gates on 7770, and its stray-run sweep matches the model path so it cannot take frank-small down.
22 lines
709 B
Desktop File
22 lines
709 B
Desktop File
[Unit]
|
|
Description=CIRU v4.4.1 Orca Qwen3.8-Flash (dankclaw, frank-large, Strix Halo iGPU gfx1151)
|
|
After=network-online.target
|
|
Wants=network-online.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=dank
|
|
Group=dank
|
|
# The engine pins staging buffers and the PLE pager's hot window; keep the
|
|
# memlock budget unbounded so an RLIMIT smaller than the pinned set cannot
|
|
# fail the load. Parity with the halogen quadlet's Ulimit=memlock=-1:-1 and
|
|
# the other LLM units on this fleet.
|
|
LimitMEMLOCK=infinity
|
|
Environment="FRANK_LARGE_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-large.env"
|
|
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-large.sh
|
|
Restart=on-failure
|
|
RestartSec=10
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target
|