frank-default-large: fix STRIX_LEAN model paths + add mmproj
The env file had the old STRIX paths (directory doesn't exist on disk). Updated to the actual running STRIX_LEAN (Uncensored) variant: - MODEL_DIR → kingjones-Qwen3.8-Flash-Next-Uncensored-ROCmFP4-STRIX_LEAN - MODEL_FILE → 3-shard Q4_0 (00001-of-00003) - MMPROJ_PATH → mmproj-Qwen3.8-Flash-Next-Uncensored-BF16.gguf - serve-frank-large.sh: add --mmproj $MMPROJ_PATH Reconciles the uncommitted local changes that were on Dankclaw.
This commit is contained in:
@@ -35,8 +35,10 @@ LLAMA_BIN=/home/dank/GitPackages/ROCmFPX/build-qwen38/bin/llama-server
|
||||
|
||||
# Model files from
|
||||
# https://huggingface.co/kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX-GGUF
|
||||
MODEL_DIR=/home/dank/models/kingjones-Qwen3.8-Flash-Next-ROCmFP4-STRIX
|
||||
MODEL_FILE=Qwen3.8-Flash-Next-Q4_0-ROCmFP4-STRIX.gguf
|
||||
# STRIX_LEAN (Uncensored) variant, 3-shard Q4_0_ROCMFP4, 98.5 GiB.
|
||||
MODEL_DIR=/home/dank/models/kingjones-Qwen3.8-Flash-Next-Uncensored-ROCmFP4-STRIX_LEAN
|
||||
MODEL_FILE=Qwen3.8-Flash-Next-Uncensored-Q4_0-ROCmFP4-STRIX_LEAN-00001-of-00003.gguf
|
||||
MMPROJ_PATH=/home/dank/models/kingjones-Qwen3.8-Flash-Next-Uncensored-ROCmFP4-STRIX_LEAN/mmproj-Qwen3.8-Flash-Next-Uncensored-BF16.gguf
|
||||
|
||||
# Qwen-Sharp chat template (tracked in the repo, staged on the host). The
|
||||
# Sharp template drives thinking on by default (medium effort); the server
|
||||
|
||||
@@ -161,4 +161,5 @@ exec /usr/bin/env \
|
||||
--reasoning "$REASONING" \
|
||||
--reasoning-format "$REASONING_FORMAT" \
|
||||
--reasoning-budget -1 \
|
||||
--mmproj "$MMPROJ_PATH" \
|
||||
"${SPEC_ARGS[@]}"
|
||||
Reference in New Issue
Block a user