[Unit] Description=llama.cpp (PrismML build 10754) Ternary-Bonsai-2-27B PQ2_0 GGUF (qwen35 hybrid, 2x200704 slots, q8_0 K+V, MTP off, mmproj vision) on the RTX 3090 (dankclaw, frank-zealot) After=network-online.target Wants=network-online.target [Service] Type=simple User=dank Group=dank # CUDA pins its staging buffers, so the process needs the memlock budget even # though the weights themselves are copied into VRAM. LimitMEMLOCK=infinity Environment="FRANK_ZEALOT_ENV_FILE=/home/dank/serverAppConfigs/scripts/frank-zealot.env" ExecStart=/home/dank/serverAppConfigs/scripts/serve-frank-zealot.sh Restart=on-failure RestartSec=10 [Install] WantedBy=multi-user.target