dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

frank-large: restore serve-script defaults eaten by the guard edit

Browse Source
This commit is contained in:
Frank committed 2026-09-16 00:06:46 -07:00
1 parent 0022ba96ad
commit f7cda17518
1 file changed
+6
Download Patch File Download Diff File Expand all files Collapse all files
scripts/serve-frank-large.sh
+6
View File
@@ -53,6 +53,12 @@ fi
: "${NGL:=999}" : "${NGL:=999}"
: "${CPU_MOE:=on}" : "${CPU_MOE:=on}"
: "${FLASH_ATTN:=on}" : "${FLASH_ATTN:=on}"
: "${TEMPERATURE:=0.0}"
: "${REASONING:=on}"
: "${REASONING_FORMAT:=deepseek}"
: "${REASONING_BUDGET:=-1}"
: "${CACHE_RAM:=8192}"
: "${SLOT_SAVE_PATH:=$SCRIPT_DIR/slot-state}"
# Hard guard: on this host CUDA pinned host memory strands the co-tenants # Hard guard: on this host CUDA pinned host memory strands the co-tenants
# (measured 2026-09-15: a default-policy start tried to page-lock 108.12 GiB, # (measured 2026-09-15: a default-policy start tried to page-lock 108.12 GiB,
# evicted every co-tenant into swap and starved sshd into unreachability # evicted every co-tenant into swap and starved sshd into unreachability