dank/serverAppConfigs
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: OKF v0.1 compliance pass + fact-check + 3 research briefs

Browse Source 
- Migrate all 127 non-reserved docs to OKF v0.1 frontmatter (type/description/tags/timestamp); fix 13 YAML issues, 2 duplicate-FM blocks, strip reserved-page FM
- Restructure log.md to OKF (## YYYY-MM-DD, newest-first)
- Fact-check against scripts/AGENTS.md ground truth: fix 6 false 'Active' banners on retired runbooks, 96->114 GiB GTT, deployment.md vs deploy-plan.py/deploy-remote.sh, Deployment Flow frank-medium=Quadlet, Calibre 9.9.0->9.15.0 + CVE-2025-7404 conflation, Copyparty v1.20.24, RomM 5.3.0 breaking change
- Move *arr docs to new FrankBook-Pro/ section (git mv, link-safe)
- Write active runbook bodies from ground truth (frank-large, frank-small)
- Add 3 research briefs + HTML report: Local TTS and Voice Cloning, AI Job Search and Resume Tools, Most Popular Self-Hosted AI Apps (Jun-Sep 2026)
- Add upstream-version rows to ComfyUI/OpenWebUI/Hermes app docs
- All 336 tests pass; 136 pages, 0 unresolved wikilinks
This commit is contained in:
Frank
2026-09-22 02:09:41 -07:00
parent 24f7a7772d
commit 93d1181fee
103 changed files with 2047 additions and 4329 deletions
Download Patch File Download Diff File Expand all files Collapse all files
serverAppConfigs-docs/LLM/deployment.md
+34 -33
View File
@@ -21,7 +21,7 @@ SearXNG, Caddy, or another container service does **not** restart inference.
|---|---|---|---:|
| Dankserver | `dank@dankserver` | `frank-medium` | 7770 |
| Dankclaw | `dank@dankclaw` | `frank-large` | 7770 |
| Dankclaw | `dank@dankclaw` | `frank-npu` (FLM on the XDNA2 NPU) | 7771 |
| Dankclaw | `dank@dankclaw` | `frank-small` | 7771 |
## Scoped workflow
@@ -47,49 +47,49 @@ Run the unified deployer from the repository root:
Without `--service`, `scripts/deploy-plan.py` maps changed files to the service
on the selected host. The following files select the corresponding service:
- `scripts/frank-medium.env`, `frank-medium.service`, and
`serve-frank-medium.sh` select `frank-medium` on Dankserver.
- Any file under `dankserver/frank-medium/` (the Quadlet unit, its
entrypoint and its healthcheck) selects `frank-medium` on Dankserver —
the container mounts the entrypoint and healthcheck straight out of the
checkout, so any file there changes deployed state.
- `scripts/frank-large.env`, `frank-large.service`, and
`serve-frank-large.sh` select `frank-large` on Dankclaw.
- `scripts/frank-npu.env`, `frank-npu.service`,
and `serve-frank-npu.sh` select `frank-npu`
on Dankclaw.
- `scripts/chat-template.jinja` selects the LLM on the selected host only.
- `scripts/frank-small.env`, `frank-small.service`, and
`serve-frank-small.sh` select `frank-small` on Dankclaw.
- Documentation, tests, deployment tooling, and unrelated container changes
do not select either inference service.
do not select any inference service.
The target-side `scripts/deploy-remote.sh` installs the selected service: for a
**root unit** it relinks the repo file into `/etc/systemd/system/`, reloads
systemd, enables it and restarts it (frank-small); for a **Quadlet** it retires
the predecessor, stops the service's own unit, waits for the published port to
clear, installs the `.container` and restarts the generated unit (frank-large).
Each handler then waits on that service's health endpoint —
`http://127.0.0.1:7770/health` for frank-large, `http://127.0.0.1:7771/health`
for frank-small. The wait budget is 20 minutes because cold model loads are
slow: halogen pins ~68 GiB of weights before it serves anything. A failed
handler does not advance its per-service state.
The target-side `scripts/deploy-remote.sh` installs the selected service.
`frank-large` and `frank-small` are **root units**: the handler relinks the
repo file into `/etc/systemd/system/` (`relink_unit`), reloads systemd,
enables it and restarts it. `frank-medium` is a **rootless Quadlet**: the
handler retires its predecessors (the replica Quadlets and the retired llama
root unit), stops the service's own unit, waits for the published port to
clear, installs the `.container` and restarts the generated unit. Each
handler then waits on that service's health endpoint —
`http://127.0.0.1:7770/health` for frank-large and frank-medium,
`http://127.0.0.1:7771/health` for frank-small. The wait budget is 20 minutes
because cold model loads are slow. A failed handler does not advance its
per-service state.
## Unit and artifact paths
The units point into the stable target checkout:
The root units point into the stable target checkout:
```text
/home/dank/serverAppConfigs/scripts/frank-medium.service
/home/dank/serverAppConfigs/scripts/frank-large.service
/home/dank/serverAppConfigs/scripts/frank-small.service
```
`frank-medium` is a Quadlet under `dankserver/frank-medium/quadlet/`
(`frank-medium.container`) rather than a unit in `scripts/`.
The unit files and serve scripts validate their model/runtime artifacts before
starting. `frank-large` is a Quadlet under `dankclaw/frank-large/quadlet/`
rather than a unit in `scripts/`; `frank-small` keeps the unit/env/serve trio
above. Keep `REMOTE_DIR` stable; moving the checkout requires updating both the
unit absolute paths and the deployment tests in the same change.
starting. Keep `REMOTE_DIR` stable; moving the checkout requires updating both
the unit absolute paths and the deployment tests in the same change.
## NPU unit
## Retired endpoints
`frank-npu` is an inactive, historical Dankclaw endpoint. It is
relinked only when explicitly selected with `--service frank-npu`; the
large-model handler never restarts it. This is intentional: the NPU is not part
of the active inference path and should not be disturbed by a large-model
change.
`frank-npu` (the FastFlowLM XDNA2 NPU endpoint) was retired on 2026-09-11
with the `amd_iommu=off` decision and is no longer a deployable service — the
planner has no `frank-npu` entry. Its runbook is [[frank-npu]].
## Isolation guarantee
@@ -110,9 +110,10 @@ change in that service's inputs.
If the LLM handler fails after the target pull:
1. Inspect `journalctl -u frank-small -n 200` (root unit) or
`journalctl --user -u frank-large -n 200` (rootless Quadlet).
2. Confirm the model files, the runtime binary and (for frank-large) the
1. Inspect `journalctl -u frank-large -n 200` or `journalctl -u frank-small
-n 200` (root units), or `journalctl --user -u frank-medium -n 200`
(rootless Quadlet).
2. Confirm the model files, the runtime binary and (for frank-medium) the
container image are present and readable by `dank`.
3. Retry only the affected service: