fix serve script: restore : (not ::) for default-value assignments
The edit tool mangled : to :: on 4 lines. Bash requires : for default value assignment (:: is not a valid command). Fixes exit code 127.
This commit is contained in:
1 parent
1ca3db4ae2
commit
f69efcdde6
1 file changed
+4
-4
@@ -47,8 +47,8 @@ fi
|
|||||||
: "${LISTEN_PORT:=7770}"
|
: "${LISTEN_PORT:=7770}"
|
||||||
: "${CTX_SIZE:=401408}"
|
: "${CTX_SIZE:=401408}"
|
||||||
: "${PARALLEL:=2}"
|
: "${PARALLEL:=2}"
|
||||||
:: "${BATCH_SIZE:=4096}"
|
: "${BATCH_SIZE:=4096}"
|
||||||
:: "${UBATCH_SIZE:=512}"
|
: "${UBATCH_SIZE:=512}"
|
||||||
: "${NUM_THREADS:=16}"
|
: "${NUM_THREADS:=16}"
|
||||||
: "${THREAD_BATCH:=16}"
|
: "${THREAD_BATCH:=16}"
|
||||||
: "${CACHE_TYPE_K:=f16}"
|
: "${CACHE_TYPE_K:=f16}"
|
||||||
@@ -67,8 +67,8 @@ fi
|
|||||||
: "${PRESENCE_PENALTY:=1.5}"
|
: "${PRESENCE_PENALTY:=1.5}"
|
||||||
: "${REASONING:=on}"
|
: "${REASONING:=on}"
|
||||||
: "${REASONING_FORMAT:=deepseek}"
|
: "${REASONING_FORMAT:=deepseek}"
|
||||||
:: "${HSA_OVERRIDE_GFX_VERSION:=11.5.1}"
|
: "${HSA_OVERRIDE_GFX_VERSION:=11.5.1}"
|
||||||
:: "${SPEC_TYPE:=none}"
|
: "${SPEC_TYPE:=none}"
|
||||||
: "${DRAFT_MODEL_DIR:=/home/dank/models/mtp-Qwen3.8-Flash-Next-FAST}"
|
: "${DRAFT_MODEL_DIR:=/home/dank/models/mtp-Qwen3.8-Flash-Next-FAST}"
|
||||||
: "${DRAFT_MODEL_FILE:=Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST.gguf}"
|
: "${DRAFT_MODEL_FILE:=Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST.gguf}"
|
||||||
: "${SPEC_DRAFT_N_MAX:=3}"
|
: "${SPEC_DRAFT_N_MAX:=3}"
|
||||||
|
|||||||
Reference in new issue
Block a user