docs: cross-link the vllmScripts project (model endpoints + git host)

- README: fix broken 'Also See' placeholder URL -> live Gitea LAN URL
- index.md: expand vllmScripts See Also with the endpoints it serves
- OpenWebUI.md: :7770 backend is the llama.cpp PP head (split to the
  3090), managed by vllmScripts; note the FLM NPU :52625 alternative;
  fix the broken [[llama.cpp Server]] wikilink
- Gitea.md: hosted repositories table (both projects)
- Dankclaw Stack.md: host-level LLM endpoints in the service inventory
- AGENTS.md: runtime note — LLM endpoints live in vllmScripts, not here

Pre-existing failures (untracked ComfyUI WIP): tests 6, 8, 9, 10.
Docs seams green: ok 19 (compose service docs), ok 20 (index links).
This commit is contained in:
Frank
2026-08-16 23:19:54 -07:00
parent 04112e88e6
commit c353725ea5
6 changed files with 38 additions and 6 deletions
+9 -2
View File
@@ -1,6 +1,6 @@
# Dankclaw Stack
Dankclaw (192.168.0.143) runs the AI, search, and development stack. It hosts the inference endpoint (llama.cpp, port 7770, from the `vllmScripts` repo), the agent tools, the privacy search, and the observability stack.
Dankclaw (192.168.0.143) runs the AI, search, and development stack. It hosts the inference endpoints (llama.cpp PP head `:7770`, FastFlowLM NPU `:52625`, both from the `vllmScripts` repo), the agent tools, the privacy search, and the observability stack.
```mermaid
graph LR
@@ -11,8 +11,9 @@ graph LR
C --> F[ComfyUI]
C --> D[Grafana]
S --> V[Gluetun VPN]
O --> L[llama.cpp :7770]
O --> L[llama.cpp PP head :7770]
O --> H[Hermes]
N[FastFlowLM NPU :52625]
```
## Services
@@ -27,6 +28,11 @@ graph LR
| Grafana | grafana.dankclaw.local | 3002 | [[Grafana]] |
| Prometheus | prometheus.dankclaw.local | 9090 | [[Prometheus]] |
| Homepage | dankclaw.local | 80/443 | — |
| frank-default-large (host service) | — | 7770 | [vllmScripts](../../vllmScripts/docs/index.md) |
| frank-default-small (host service) | — | 52625 | [vllmScripts](../../vllmScripts/docs/index.md) |
The last two rows are bare-metal systemd services, not containers. The
`vllmScripts` repository owns their scripts and knowledge base.
## Routing Rules
@@ -39,3 +45,4 @@ graph LR
- [[index]] — repository index
- [[Network Architecture]] — routing and proxy
- [[Observability]] — Grafana, Prometheus, logs
- [vllmScripts knowledge base](../../vllmScripts/docs/index.md) — the model-serving endpoints on this host
+9
View File
@@ -14,6 +14,15 @@ Gitea is a self-hosted Git service with issues, pull requests, and a web UI. On
The containers share the private bridge network `systemd-gitea`. The quadlet network file `gitea.network` enables DNS, so the containers resolve each other by name. The automatic `podman` default network has DNS disabled. Do not run the Gitea containers on it.
## Hosted repositories
| Repository | Purpose |
|------------|---------|
| `dank/serverAppConfigs` | this repo — Podman stack configs |
| `dank/vllmScripts` | model-serving scripts: llama.cpp PP head (`:7770`), FastFlowLM NPU (`:52625`), RPC worker (`:50052`) |
The vllmScripts knowledge base: [../vllmScripts/docs/index.md](../../vllmScripts/docs/index.md)
## Management
Run all commands as `dank` on Dankclaw.
+11 -2
View File
@@ -11,7 +11,7 @@ OpenWebUI is a self-hosted chat interface for LLMs. It connects to OpenAI-compat
| Image | `ghcr.io/open-webui/open-webui:main` (CPU build for non-NVIDIA hosts) |
| Port | 3000 (host) → 8080 (container) |
| Data volume | config, sessions, RAG indexes |
| Backend | OpenAI-compatible endpoint at `http://localhost:7770/v1` (llama.cpp) |
| Backend | OpenAI-compatible endpoint at `http://localhost:7770/v1` — the llama.cpp PP head (Qwen3.8-27B, tensors split to the Dankserver RTX 3090 worker) |
> Note: the `:cuda` image tag was previously used on Dankserver. Dankclaw is AMD; use the default (CPU) image, NOT the cuda tag.
@@ -27,6 +27,15 @@ environment:
The hostname `host.containers.internal` reaches the podman host where llama.cpp listens on 7770.
> The `:7770` endpoint is the `frank-default-large` service, managed by
> the sibling `vllmScripts` repository (not this repo). Model swaps,
> context sizing, and spec tuning happen there. See the
> [vllmScripts knowledge base](../../vllmScripts/docs/index.md).
>
> Alternative backend: `frank-default-small` on port 52625 (FastFlowLM,
> AMD NPU, `qwen3.6-moe:35b-a3b`). Same OpenAI-compatible API shape. Point
> `OPENAI_API_BASE_URL` at `http://host.containers.internal:52625/v1`.
## Volumes
| Container path | Host path (convention) |
@@ -47,4 +56,4 @@ OpenWebUI responds on `/health` with 200.
- [[Dankclaw Stack]]
- [[Hermes]] — the agent OpenWebUI can talk to
- Knowledge base: [[llama.cpp Server]]
- [vllmScripts knowledge base](../../vllmScripts/docs/index.md) — the llama.cpp PP head and FastFlowLM NPU endpoints
+4 -1
View File
@@ -61,5 +61,8 @@ This repository tracks the container stacks for both hosts. Git is the single so
## See Also
- [vllmScripts repository](../vllmScripts/docs/index.md) — the deployment model this repo follows
- [vllmScripts repository](../vllmScripts/docs/index.md) — the model-serving
scripts on the same hosts: `frank-default-large` (llama.cpp PP head,
port 7770, consumed by OpenWebUI) and `frank-default-small` (FastFlowLM
NPU, port 52625). Git workflow model for this repo.
- [[AGENTS.md]] — repository rules