Frank
fbfbc5c6db
Operator request (2026-08-22): the primary inference server (frank-default-large, the 27B CIRU model on Dankclaw) moves to the standard llama.cpp port 7770. Both LLM services now listen on :7770, distinguished by host (dankserver vs dankclaw). Functional changes: - scripts/frank-default-large.env: LISTEN_PORT 52625 -> 7770 - scripts/serve-frank-large.sh: default LISTEN_PORT 52625 -> 7770 - scripts/deploy.sh: LLM_HEALTH[dankclaw] -> :7770 - open-webui quadlet: OPENAI_API_BASE_URL -> 192.168.0.143:7770 (re-pointed so chat keeps working; data dir preserved) - scripts/bench-fast-greedy.sh: PORT 52625 -> 7770 Tests updated to the new topology (both LLM endpoints on :7770 by host; open-webui -> :7770). Docs + pi KB updated; dated historical runbooks keep their point-in-time ports. models.json (pi client) re-pointed to :7770 separately, effective on the next client restart.
62 lines
2.5 KiB
Markdown
62 lines
2.5 KiB
Markdown
# Dankclaw Stack
|
|
|
|
Dankclaw (192.168.0.143) runs the AI, search, and development stack. It
|
|
hosts the LLM inference endpoint (`frank-default-large`, `:7770`, CIRU
|
|
ROCmFPX llama.cpp), the agent tools, the privacy search, and the
|
|
observability stack. The llama.cpp endpoint (`frank-default-small`,
|
|
`:7770`) runs on Dankserver (192.168.0.235).
|
|
|
|
```mermaid
|
|
graph LR
|
|
U[User] --> C[Caddy :80/:443]
|
|
C --> O[OpenWebUI]
|
|
C --> S[SearXNG]
|
|
C --> G[Gitea]
|
|
C --> F[ComfyUI]
|
|
C --> D[Grafana]
|
|
S --> V[Gluetun VPN]
|
|
O --> L[llama.cpp dankserver :7770]
|
|
O --> H[Hermes]
|
|
O --> E[CIRU llama.cpp :7770]
|
|
```
|
|
|
|
## Services
|
|
|
|
| Service | Hostname | Port | Docs |
|
|
|---------|----------|------|------|
|
|
| SearXNG | search.dankclaw.local | 8081 | [[SearXNG]] |
|
|
| ComfyUI | comfyui.dankclaw.local | 8188 | [[ComfyUI]] |
|
|
| OpenWebUI | chat.dankclaw.local | 3005 | [[OpenWebUI]] |
|
|
| Hermes | hermes.dankclaw.local | 8090 | [[Hermes]] |
|
|
| Gitea | gitea.dankclaw.local | 3000 | [[Gitea]] |
|
|
| Grafana | grafana.dankclaw.local | 3002 | [[Grafana]] |
|
|
| Prometheus | prometheus.dankclaw.local | 9090 | [[Prometheus]] |
|
|
| Homepage | dankclaw.local | 80/443 | — |
|
|
| frank-default-large (host service, Dankclaw) | — | 7770 | [[deployment]] |
|
|
| frank-default-small (host service, Dankserver) | — | 7770 | [[deployment]] |
|
|
|
|
The last two rows are bare-metal systemd services, not containers. This
|
|
repo owns their scripts, units, and knowledge base (see
|
|
[docs/LLM/index.md](../LLM/index.md)). Current mapping (2026-08-22):
|
|
`frank-default-large` runs the CIRU ROCmFPX llama.cpp on Dankclaw;
|
|
`frank-default-small` runs the upstream llama.cpp on Dankserver.
|
|
|
|
## Boot Persistence
|
|
|
|
The Gitea trio, the SearXNG trio (gluetun, searxng, valkey), and open-webui run as quadlet units, so they start at boot. User linger is on. ComfyUI runs as a systemd unit around a bare process. The remaining services in the table are defined in `compose.yaml` and are not yet boot-persistent.
|
|
|
|
Deploy the SearXNG trio with `scripts/deploy-searxng-quadlet.sh dankclaw` and open-webui with `scripts/deploy-open-webui-quadlet.sh dankclaw`. The Gitea units install to `~/.config/containers/systemd/` (see [[Gitea]]).
|
|
|
|
## Routing Rules
|
|
|
|
- SearXNG outbound traffic exits through the [[Gluetun]] VPN container.
|
|
- Every other service uses the normal LAN route.
|
|
- The homepage lists all services with status.
|
|
|
|
## See Also
|
|
|
|
- [[index]] — repository index
|
|
- [[Network Architecture]] — routing and proxy
|
|
- [[Observability]] — Grafana, Prometheus, logs
|
|
- [LLM fleet knowledge base](../LLM/index.md) — the model-serving endpoints on this host
|