dank/serverAppConfigs
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: fleet topology update — PP split renamed frank-default-large, NPU endpoint promoted to frank-default-small, 4-model NPU bakeoff matrix (2026-08-16)

Browse Source
This commit is contained in:
Frank committed 2026-08-16 14:22:13 -07:00
1 parent 3f42210922
commit d0ade28f6d
4 files changed
+48 -19
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

AGENTS.md
+6 -5
View File
@@ -14,7 +14,7 @@ when the bench finishes. The users will call if they need the model.
Rules:
1. Stop the service before any benchmark: `systemctl stop frank-default-large`
(Dankclaw) or `systemctl stop frank-default-small` (Dankserver). Use the
(Dankclaw) or `systemctl stop frank-default-small` (Dankclaw NPU). Use the
passwordless helper or the password `Assface.3241` with `sudo -S`.
2. Run the bench on a scratch port (never the service port 7770).
3. Restart the service when the bench completes: `systemctl start <svc>`.
@@ -41,8 +41,8 @@ All script edits must flow through git. Do not edit files on the remote machine
Use `scripts/deploy.sh` to deploy committed changes to a target. It pushes `main`, pulls on the target, restarts the service, and checks the health endpoint.
```
./scripts/deploy.sh dankclaw # vLLM (frank-default-large, port 7770)
./scripts/deploy.sh dankserver # llama.cpp (frank-default-small, port 7770)
./scripts/deploy.sh dankclaw # PP head (frank-default-large, port 7770)
./scripts/deploy.sh dankserver # PP worker (frank-pp-worker, RPC 50052)
./scripts/deploy.sh dankclaw --dry-run # preview without changes
```
@@ -61,8 +61,9 @@ Target map:
| Target | Host | Runtime | Service | Port |
|--------|------|---------|---------|------|
| Dankclaw | dank@dankclaw | llama.cpp (UD-Q8_K_XL, `--spec-default` ngram-mod, Vulkan0, 2 slots) | frank-default-large | 7770 |
| Dankserver | dank@dankserver | llama.cpp (Q6_K_P + ngram-mod, MoE offload) | frank-default-small | 7770 |
| Dankclaw | dank@dankclaw | llama.cpp PP head (Qwen3.8-27B UD-Q8_K_XL, split 0.40/0.60 to the Dankserver worker via RPC, MTP+ngram-mod, f16 KV) | frank-default-large | 7770 |
| Dankclaw | dank@dankclaw | FastFlowLM NPU (XDNA2 50 TOPS, gemma4-it:e4b; see [[FastFlowLM NPU Inference]]) | frank-default-small | 52625 |
| Dankserver | dank@dankserver | ggml-rpc worker (RTX 3090, receives the head's tensor share) | frank-pp-worker | 50052 |
## Runtime & Troubleshooting