dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: reflect Ling-3 vLLM (frank-default-large) on Dankclaw

Browse Source 
Update target maps (AGENTS, README, deployment, deploy.sh) from the retired
ROCmFPX llama.cpp stack to the active vLLM-ROCm CIRU INT4 service on port 7770
with MTP speculative decoding. Align Dankserver to the running
vllm-awq-qwen36 (AWQ, port 34401). Refresh KB pages: Dankclaw system specs
(gpu-mem-util 0.95, CIRU venv), quantization choices (INT4 primary, MXFP4
experiment), DFlash/DSpark Dankclaw section, and the KB index topology.
This commit is contained in:
Frank committed 2026-08-10 23:37:27 -07:00
1 parent 52ad985978
commit 903d54c389
9 files changed
+55 -54
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

scripts/deploy.sh
+7 -7
View File
@@ -12,8 +12,8 @@
# ./deploy.sh <target> [--dry-run]
#
# Targets:
# dankclaw - ROCmFPX llama.cpp server (llama-server.service, port 8080)
# dankserver - vLLM server (vllm-qwen36.service, port 8000)
# dankclaw - vLLM-ROCm server (frank-default-large.service, port 7770)
# dankserver - vLLM server (vllm-awq-qwen36.service, port 34401)
#
# Example:
# ./deploy.sh dankclaw
@@ -28,14 +28,14 @@ declare -A REMOTE_USER REMOTE_HOST REMOTE_DIR SERVICE SERVICE_HEALTH
REMOTE_USER[dankclaw]=dank
REMOTE_HOST[dankclaw]=dankclaw
REMOTE_DIR[dankclaw]="/home/dank/vllmScripts"
SERVICE[dankclaw]="llama-server"
SERVICE_HEALTH[dankclaw]="http://127.0.0.1:8080/health"
SERVICE[dankclaw]="frank-default-large"
SERVICE_HEALTH[dankclaw]="http://127.0.0.1:7770/health"
REMOTE_USER[dankserver]=dank
REMOTE_HOST[dankserver]=dankserver
REMOTE_DIR[dankserver]="/home/dank/vLLM"
SERVICE[dankserver]="vllm-qwen36"
SERVICE_HEALTH[dankserver]="http://127.0.0.1:8000/health"
SERVICE[dankserver]="vllm-awq-qwen36"
SERVICE_HEALTH[dankserver]="http://127.0.0.1:34401/health"
TARGET="${1:-}"
DRY_RUN=0
@@ -103,7 +103,7 @@ git pull origin main
# Install / symlink the systemd unit
case '${TARGET}' in
dankclaw)
sudo ln -sf '${REMOTE_DIR[$TARGET]}/scripts/llama-server.service' /etc/systemd/system/llama-server.service
sudo ln -sf '${REMOTE_DIR[$TARGET]}/scripts/frank-default-large.service' /etc/systemd/system/frank-default-large.service
;;
dankserver)
# vllm-qwen36.service is a physical file; no symlink needed.