Frank
1ba9618fcc
- Restore the pre-2026-08-17 Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q6_K_P + ngram-mod setup as frank-default-small on Dankserver (port 7770, upstream llama.cpp b10121, MoE experts on CPU via --n-cpu-moe 36). - Rename the CIRU Qwen3.8-27B ActiveFPX setup from frank-default-small to frank-default-large (Dankclaw, port 52625); bump to CTX_SIZE=262144 (native max) and PARALLEL=2 (96 GiB unified pool). - Retire the Qwen3.8-27B IQ4_XS FastMTP frank-default-large (Dankserver) to .AGENTTRASH. - deploy.sh: SERVICE[dankserver]=frank-default-small, SERVICE[dankclaw]=frank-default-large; HEALTH_WAIT[dankserver]=600.
17 lines
407 B
Desktop File
17 lines
407 B
Desktop File
[Unit]
|
|
Description=llama.cpp Qwen3.6-35B-A3B Q6_K_P + ngram-mod (dankserver, frank-default-small)
|
|
After=network-online.target
|
|
Wants=network-online.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=dank
|
|
Group=dank
|
|
Environment="FRANK_SMALL_ENV_FILE=/home/dank/vLLM/scripts/frank-default-small.env"
|
|
ExecStart=/home/dank/vLLM/scripts/serve-frank-small.sh
|
|
Restart=on-failure
|
|
RestartSec=10
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target
|