Frank
e367f0f43c
- docs/index.md: LLM Fleet section (all 34 pages linked), merge note, See Also now internal - docs/LLM/index.md: retitled, dangling [[Dankserver]]/[[Dankclaw]] links fixed, sibling section replaced with internal links - docs/LLM/deployment.md: rewritten for the unified deploy flow, manual-update paths point at the merged checkout, incident history kept intact - Deployment Flow / Dankclaw Stack / Gitea: stale vllmScripts references and retired-topology notes updated to the 2026-08-22 state - Historical docs (frank-redo, PP deployment, FastFlowLM) keep their dated runbook paths as-is (records of retired topologies)
2.6 KiB
Dankclaw Stack
Dankclaw (192.168.0.143) runs the AI, search, and development stack. It
hosts the LLM inference endpoint (frank-default-large, :52625, CIRU
ROCmFPX llama.cpp), the agent tools, the privacy search, and the
observability stack. The llama.cpp endpoint (frank-default-small,
:7770) runs on Dankserver (192.168.0.235).
graph LR
U[User] --> C[Caddy :80/:443]
C --> O[OpenWebUI]
C --> S[SearXNG]
C --> G[Gitea]
C --> F[ComfyUI]
C --> D[Grafana]
S --> V[Gluetun VPN]
O --> L[llama.cpp dankserver :7770]
O --> H[Hermes]
O --> E[CIRU llama.cpp :52625]
Services
| Service | Hostname | Port | Docs |
|---|---|---|---|
| SearXNG | search.dankclaw.local | 8081 | SearXNG |
| ComfyUI | comfyui.dankclaw.local | 8188 | ComfyUI |
| OpenWebUI | chat.dankclaw.local | 3005 | OpenWebUI |
| Hermes | hermes.dankclaw.local | 8090 | Hermes |
| Gitea | gitea.dankclaw.local | 3000 | Gitea |
| Grafana | grafana.dankclaw.local | 3002 | Grafana |
| Prometheus | prometheus.dankclaw.local | 9090 | Prometheus |
| Homepage | dankclaw.local | 80/443 | — |
| frank-default-large (host service, Dankclaw) | — | 52625 | deployment |
| frank-default-small (host service, Dankserver) | — | 7770 | deployment |
The last two rows are bare-metal systemd services, not containers. This
repo owns their scripts, units, and knowledge base (see
docs/LLM/index.md). Current mapping (2026-08-22):
frank-default-large runs the CIRU ROCmFPX llama.cpp on Dankclaw;
frank-default-small runs the upstream llama.cpp on Dankserver.
Boot Persistence
The Gitea trio, the SearXNG trio (gluetun, searxng, valkey), and open-webui run as quadlet units, so they start at boot. User linger is on. ComfyUI runs as a systemd unit around a bare process. The remaining services in the table are defined in compose.yaml and are not yet boot-persistent.
Deploy the SearXNG trio with scripts/deploy-searxng-quadlet.sh dankclaw and open-webui with scripts/deploy-open-webui-quadlet.sh dankclaw. The Gitea units install to ~/.config/containers/systemd/ (see Gitea).
Routing Rules
- SearXNG outbound traffic exits through the Gluetun VPN container.
- Every other service uses the normal LAN route.
- The homepage lists all services with status.
See Also
- index — repository index
- Network Architecture — routing and proxy
- Observability — Grafana, Prometheus, logs
- LLM fleet knowledge base — the model-serving endpoints on this host