Frank
fbfbc5c6db
Operator request (2026-08-22): the primary inference server (frank-default-large, the 27B CIRU model on Dankclaw) moves to the standard llama.cpp port 7770. Both LLM services now listen on :7770, distinguished by host (dankserver vs dankclaw). Functional changes: - scripts/frank-default-large.env: LISTEN_PORT 52625 -> 7770 - scripts/serve-frank-large.sh: default LISTEN_PORT 52625 -> 7770 - scripts/deploy.sh: LLM_HEALTH[dankclaw] -> :7770 - open-webui quadlet: OPENAI_API_BASE_URL -> 192.168.0.143:7770 (re-pointed so chat keeps working; data dir preserved) - scripts/bench-fast-greedy.sh: PORT 52625 -> 7770 Tests updated to the new topology (both LLM endpoints on :7770 by host; open-webui -> :7770). Docs + pi KB updated; dated historical runbooks keep their point-in-time ports. models.json (pi client) re-pointed to :7770 separately, effective on the next client restart.
51 lines
2.1 KiB
INI
51 lines
2.1 KiB
INI
# Quadlet unit: open-webui (rootless, boot-persistent).
|
|
#
|
|
# Install path on dankclaw: ~/.config/containers/systemd/open-webui.container
|
|
# Unit name: open-webui.service (container name: open-webui)
|
|
#
|
|
# Chat UI for the LLM fleet. It runs on the CPU image (dankclaw is CPU-only, so
|
|
# the :cuda image would waste a large pull for a GPU it cannot use) and points
|
|
# its OpenAI connection at the live llama.cpp backend on this host via the
|
|
# host LAN IP (192.168.0.143:7770, model frank-default-large). It publishes 3005
|
|
# (3000 is Gitea's HTTP port). Data persists under
|
|
# /home/dank/Containers/open-webui/data. See docs/Dankclaw/OpenWebUI.md.
|
|
#
|
|
# Network history (2026-08-22): this unit used Network=slirp4netns. When the
|
|
# slirp4netns helper process died, the container kept running but lost its tap
|
|
# interface: a zombie that accepted TCP and reset every request, and chat
|
|
# served empty responses for ~2 days with no error anywhere. It now runs on a
|
|
# pinned bridge network (open-webui.network), which has no per-container
|
|
# helper to die. The LLM is reached via the host LAN IP (192.168.0.143):
|
|
# the bridge gateway lives in the rootless netns, not the host netns where
|
|
# llama-server runs. The healthcheck probes /health (app liveness) and
|
|
# requires a non-loopback interface (network liveness).
|
|
|
|
[Unit]
|
|
Description=open-webui chat UI container
|
|
After=network.target
|
|
|
|
[Container]
|
|
ContainerName=open-webui
|
|
Network=open-webui.network
|
|
Image=ghcr.io/open-webui/open-webui:main
|
|
PublishPort=3005:8080
|
|
Environment=OPENAI_API_BASE_URL=http://192.168.0.143:7770
|
|
Environment=ANONYMIZED_TELEMETRY=False
|
|
Environment=DO_NOT_TRACK=True
|
|
Volume=/home/dank/Containers/open-webui/data:/app/backend/data
|
|
|
|
# App liveness (/health) AND network liveness (a non-loopback interface must
|
|
# exist; a dead tap leaves only "lo" behind).
|
|
HealthCmd=CMD-SHELL python -c 'import os,urllib.request,sys; urllib.request.urlopen("http://127.0.0.1:8080/health",timeout=5).read(); sys.exit(0 if any(i!="lo" for i in os.listdir("/sys/class/net")) else 1)'
|
|
HealthInterval=30s
|
|
HealthTimeout=10s
|
|
HealthRetries=3
|
|
HealthStartPeriod=300s
|
|
|
|
[Service]
|
|
TimeoutStartSec=900
|
|
Restart=always
|
|
|
|
[Install]
|
|
WantedBy=default.target
|