docs: cross-link the vllmScripts project (model endpoints + git host)
- README: fix broken 'Also See' placeholder URL -> live Gitea LAN URL - index.md: expand vllmScripts See Also with the endpoints it serves - OpenWebUI.md: :7770 backend is the llama.cpp PP head (split to the 3090), managed by vllmScripts; note the FLM NPU :52625 alternative; fix the broken [[llama.cpp Server]] wikilink - Gitea.md: hosted repositories table (both projects) - Dankclaw Stack.md: host-level LLM endpoints in the service inventory - AGENTS.md: runtime note — LLM endpoints live in vllmScripts, not here Pre-existing failures (untracked ComfyUI WIP): tests 6, 8, 9, 10. Docs seams green: ok 19 (compose service docs), ok 20 (index links).
This commit is contained in:
1 parent
04112e88e6
commit
c353725ea5
6 files changed
+38
-6
No files matched your search
@@ -11,7 +11,7 @@ OpenWebUI is a self-hosted chat interface for LLMs. It connects to OpenAI-compat
|
||||
| Image | `ghcr.io/open-webui/open-webui:main` (CPU build for non-NVIDIA hosts) |
|
||||
| Port | 3000 (host) → 8080 (container) |
|
||||
| Data volume | config, sessions, RAG indexes |
|
||||
| Backend | OpenAI-compatible endpoint at `http://localhost:7770/v1` (llama.cpp) |
|
||||
| Backend | OpenAI-compatible endpoint at `http://localhost:7770/v1` — the llama.cpp PP head (Qwen3.8-27B, tensors split to the Dankserver RTX 3090 worker) |
|
||||
|
||||
> Note: the `:cuda` image tag was previously used on Dankserver. Dankclaw is AMD; use the default (CPU) image, NOT the cuda tag.
|
||||
|
||||
@@ -27,6 +27,15 @@ environment:
|
||||
|
||||
The hostname `host.containers.internal` reaches the podman host where llama.cpp listens on 7770.
|
||||
|
||||
> The `:7770` endpoint is the `frank-default-large` service, managed by
|
||||
> the sibling `vllmScripts` repository (not this repo). Model swaps,
|
||||
> context sizing, and spec tuning happen there. See the
|
||||
> [vllmScripts knowledge base](../../vllmScripts/docs/index.md).
|
||||
>
|
||||
> Alternative backend: `frank-default-small` on port 52625 (FastFlowLM,
|
||||
> AMD NPU, `qwen3.6-moe:35b-a3b`). Same OpenAI-compatible API shape. Point
|
||||
> `OPENAI_API_BASE_URL` at `http://host.containers.internal:52625/v1`.
|
||||
|
||||
## Volumes
|
||||
|
||||
| Container path | Host path (convention) |
|
||||
@@ -47,4 +56,4 @@ OpenWebUI responds on `/health` with 200.
|
||||
|
||||
- [[Dankclaw Stack]]
|
||||
- [[Hermes]] — the agent OpenWebUI can talk to
|
||||
- Knowledge base: [[llama.cpp Server]]
|
||||
- [vllmScripts knowledge base](../../vllmScripts/docs/index.md) — the llama.cpp PP head and FastFlowLM NPU endpoints
|
||||
Reference in new issue
Block a user