Files

T

Frank fbfbc5c6db Move frank-default-large from :52625 to :7770 (dankclaw)

Operator request (2026-08-22): the primary inference server
(frank-default-large, the 27B CIRU model on Dankclaw) moves to the
standard llama.cpp port 7770. Both LLM services now listen on :7770,
distinguished by host (dankserver vs dankclaw).

Functional changes:
- scripts/frank-default-large.env: LISTEN_PORT 52625 -> 7770
- scripts/serve-frank-large.sh: default LISTEN_PORT 52625 -> 7770
- scripts/deploy.sh: LLM_HEALTH[dankclaw] -> :7770
- open-webui quadlet: OPENAI_API_BASE_URL -> 192.168.0.143:7770
  (re-pointed so chat keeps working; data dir preserved)
- scripts/bench-fast-greedy.sh: PORT 52625 -> 7770

Tests updated to the new topology (both LLM endpoints on :7770 by host;
open-webui -> :7770). Docs + pi KB updated; dated historical runbooks
keep their point-in-time ports. models.json (pi client) re-pointed to
:7770 separately, effective on the next client restart.

2026-08-22 22:11:53 -07:00

2.5 KiB

Raw Blame History

Dankclaw Stack

Dankclaw (192.168.0.143) runs the AI, search, and development stack. It hosts the LLM inference endpoint (frank-default-large, :7770, CIRU ROCmFPX llama.cpp), the agent tools, the privacy search, and the observability stack. The llama.cpp endpoint (frank-default-small, :7770) runs on Dankserver (192.168.0.235).

graph LR
    U[User] --> C[Caddy :80/:443]
    C --> O[OpenWebUI]
    C --> S[SearXNG]
    C --> G[Gitea]
    C --> F[ComfyUI]
    C --> D[Grafana]
    S --> V[Gluetun VPN]
    O --> L[llama.cpp dankserver :7770]
    O --> H[Hermes]
    O --> E[CIRU llama.cpp :7770]

Services

Service	Hostname	Port	Docs
SearXNG	search.dankclaw.local	8081	SearXNG
ComfyUI	comfyui.dankclaw.local	8188	ComfyUI
OpenWebUI	chat.dankclaw.local	3005	OpenWebUI
Hermes	hermes.dankclaw.local	8090	Hermes
Gitea	gitea.dankclaw.local	3000	Gitea
Grafana	grafana.dankclaw.local	3002	Grafana
Prometheus	prometheus.dankclaw.local	9090	Prometheus
Homepage	dankclaw.local	80/443	—
frank-default-large (host service, Dankclaw)	—	7770	deployment
frank-default-small (host service, Dankserver)	—	7770	deployment

The last two rows are bare-metal systemd services, not containers. This repo owns their scripts, units, and knowledge base (see docs/LLM/index.md). Current mapping (2026-08-22): frank-default-large runs the CIRU ROCmFPX llama.cpp on Dankclaw; frank-default-small runs the upstream llama.cpp on Dankserver.

Boot Persistence

The Gitea trio, the SearXNG trio (gluetun, searxng, valkey), and open-webui run as quadlet units, so they start at boot. User linger is on. ComfyUI runs as a systemd unit around a bare process. The remaining services in the table are defined in compose.yaml and are not yet boot-persistent.

Deploy the SearXNG trio with scripts/deploy-searxng-quadlet.sh dankclaw and open-webui with scripts/deploy-open-webui-quadlet.sh dankclaw. The Gitea units install to ~/.config/containers/systemd/ (see Gitea).

Routing Rules

SearXNG outbound traffic exits through the Gluetun VPN container.
Every other service uses the normal LAN route.
The homepage lists all services with status.

2.5 KiB Raw Blame History

Dankclaw Stack

Services

Boot Persistence

Routing Rules

See Also

2.5 KiB

Raw Blame History