Frank
f48b45c1fa
- serve script: header + every fallback default re-keyed to the Bonsai-2 trio (vendor LLAMA_BIN, PQ2_0 MODEL_FILE, Q8_0 MMPROJ) and CACHE_TYPE_*:=q8_0 — a defaulted run must land on the shipped shape, never on the retired 9B/f16 pair (the trial window proved a silent default is how a swap goes wrong) - unit Description now names the payload + KV dtype that `systemctl status` will show during the next incident - OpenWebUI decoration-row description re-keyed, with the law that the row is live DB state a swap must follow into the database
20 lines
672 B
Desktop File
20 lines
672 B
Desktop File
[Unit]
|
|
Description=llama.cpp (PrismML build 10754) Ternary-Bonsai-2-27B PQ2_0 GGUF (qwen35 hybrid, 2x200704 slots, q8_0 K+V, MTP off, mmproj vision) on the RTX 3090 (dankclaw, frank-zealot)
|
|
After=network-online.target
|
|
Wants=network-online.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=dank
|
|
Group=dank
|
|
# CUDA pins its staging buffers, so the process needs the memlock budget even
|
|
# though the weights themselves are copied into VRAM.
|
|
LimitMEMLOCK=infinity
|
|
Environment="FRANK_ZEALOT_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-zealot.env"
|
|
ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-zealot.sh
|
|
Restart=on-failure
|
|
RestartSec=10
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target
|