Swap fleet naming + restore Qwen3.6-35B-A3B Q6_K_P on Dankserver
- Restore the pre-2026-08-17 Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q6_K_P + ngram-mod setup as frank-default-small on Dankserver (port 7770, upstream llama.cpp b10121, MoE experts on CPU via --n-cpu-moe 36). - Rename the CIRU Qwen3.8-27B ActiveFPX setup from frank-default-small to frank-default-large (Dankclaw, port 52625); bump to CTX_SIZE=262144 (native max) and PARALLEL=2 (96 GiB unified pool). - Retire the Qwen3.8-27B IQ4_XS FastMTP frank-default-large (Dankserver) to .AGENTTRASH. - deploy.sh: SERVICE[dankserver]=frank-default-small, SERVICE[dankclaw]=frank-default-large; HEALTH_WAIT[dankserver]=600.
This commit is contained in:
1 parent
fe1d834d37
commit
1ba9618fcc
7 files changed
+262
-276
No files matched your search
@@ -1,5 +1,5 @@
|
||||
[Unit]
|
||||
Description=llama.cpp Qwen3.8-27B Aggressive IQ4_XS + FastMTP (dankserver, frank-default-large)
|
||||
Description=CIRU llama.cpp Qwen3.8-27B ActiveFPX PromptForge MTP (dankclaw, frank-default-large)
|
||||
After=network-online.target
|
||||
Wants=network-online.target
|
||||
|
||||
@@ -7,8 +7,8 @@ Wants=network-online.target
|
||||
Type=simple
|
||||
User=dank
|
||||
Group=dank
|
||||
Environment="FRANK_LARGE_ENV_FILE=/home/dank/vLLM/scripts/frank-default-large.env"
|
||||
ExecStart=/home/dank/vLLM/scripts/serve-frank-large.sh
|
||||
Environment="FRANK_LARGE_ENV_FILE=/home/dank/vllmScripts/scripts/frank-default-large.env"
|
||||
ExecStart=/home/dank/vllmScripts/scripts/serve-frank-large.sh
|
||||
Restart=on-failure
|
||||
RestartSec=10
|
||||
|
||||
|
||||
Reference in new issue
Block a user