Frank
fbfbc5c6db
Operator request (2026-08-22): the primary inference server (frank-default-large, the 27B CIRU model on Dankclaw) moves to the standard llama.cpp port 7770. Both LLM services now listen on :7770, distinguished by host (dankserver vs dankclaw). Functional changes: - scripts/frank-default-large.env: LISTEN_PORT 52625 -> 7770 - scripts/serve-frank-large.sh: default LISTEN_PORT 52625 -> 7770 - scripts/deploy.sh: LLM_HEALTH[dankclaw] -> :7770 - open-webui quadlet: OPENAI_API_BASE_URL -> 192.168.0.143:7770 (re-pointed so chat keeps working; data dir preserved) - scripts/bench-fast-greedy.sh: PORT 52625 -> 7770 Tests updated to the new topology (both LLM endpoints on :7770 by host; open-webui -> :7770). Docs + pi KB updated; dated historical runbooks keep their point-in-time ports. models.json (pi client) re-pointed to :7770 separately, effective on the next client restart.
63 lines
2.7 KiB
Markdown
63 lines
2.7 KiB
Markdown
# Server App Configs
|
|
|
|
The single repository for the two homelab servers: the Podman container
|
|
stacks **and** the LLM inference fleet. One repo, one checkout per host,
|
|
one deploy script.
|
|
|
|
> 2026-08-22: the former `vllmScripts` repository (LLM fleet) is merged
|
|
> into this repo with its full git history. See AGENTS.md for the merge
|
|
> note.
|
|
|
|
## Targets
|
|
|
|
| Host | User | IP | Podman stack | LLM service | LLM port |
|
|
|------|------|----|--------------|-------------|----------|
|
|
| dankserver | dank | 192.168.0.235 | media and library | frank-default-small (llama.cpp, Qwen3.6-35B-A3B) | 7770 |
|
|
| dankclaw | dank | 192.168.0.143 | AI, search, development, observability | frank-default-large (CIRU ROCmFPX, Qwen3.8-27B) | 7770 |
|
|
|
|
## Active Services
|
|
|
|
| Service | Host | Hostname | Port |
|
|
|---------|------|----------|------|
|
|
| RomM | dankserver | romm.dankserver.local | 8085 |
|
|
| Copyparty | dankserver | files.dankserver.local | 3923 |
|
|
| Calibre-Web | dankserver | books.dankserver.local | 8083 |
|
|
| frank-default-small | dankserver | — (bare endpoint) | 7770 |
|
|
| SearXNG | dankclaw | search.dankclaw.local | 8081 |
|
|
| ComfyUI | dankclaw | comfyui.dankclaw.local | 8188 |
|
|
| OpenWebUI | dankclaw | chat.dankclaw.local | 3000 |
|
|
| Hermes | dankclaw | hermes.dankclaw.local | 8090 |
|
|
| Gitea | dankclaw | gitea.dankclaw.local | 3001 |
|
|
| Grafana | dankclaw | grafana.dankclaw.local | 3002 |
|
|
| Prometheus | dankclaw | prometheus.dankclaw.local | 9090 |
|
|
| frank-default-large | dankclaw | — (bare endpoint) | 7770 |
|
|
|
|
## Structure
|
|
|
|
- `dankserver/` — compose.yaml + Caddyfile + .env.example for the Dankserver stack
|
|
- `dankclaw/` — compose.yaml + Caddyfile + .env.example for the Dankclaw stack
|
|
- `shared/` — homepage, prometheus config, deploy helpers
|
|
- `scripts/` — `deploy.sh` (unified: stack + LLM), LLM serve scripts, systemd units, env tunables, bench harnesses
|
|
- `old/` — retired PP/NPU-era LLM scripts (reference only)
|
|
- `docs/` — project knowledge base (Obsidian vault, wikilinks). `docs/LLM/` is the LLM fleet
|
|
- `tests/` — bats test suite (see [[Testing Policy]])
|
|
|
|
## Deployment
|
|
|
|
See [docs/Architecture/Deployment Flow.md](docs/Architecture/Deployment%20Flow.md)
|
|
and [docs/LLM/deployment.md](docs/LLM/deployment.md). Run
|
|
`./scripts/deploy.sh <dankclaw|dankserver>` after pushing committed changes.
|
|
It pushes, pulls on the target, restarts the podman stack and the LLM
|
|
service, and checks both health endpoints.
|
|
|
|
## Knowledge Base
|
|
|
|
The `docs/` directory is an Obsidian vault. Start at
|
|
[docs/index.md](docs/index.md). The LLM fleet knowledge base lives at
|
|
[docs/LLM/index.md](docs/LLM/index.md).
|
|
|
|
## Testing
|
|
|
|
Run `./tests/run.sh` before every push. See
|
|
[docs/Architecture/Testing Policy.md](docs/Architecture/Testing%20Policy.md).
|