Frank
cdae928f37
- Homepage.md: rewritten to the settled design (single site, user + /admin/ pages, server-side status.json via a 3-min systemd-timer checker, terminal TUI theme). Added mermaid diagrams: site structure, status states, checker flow. Recorded the classification (user vs admin; *arr excluded; LLM admin; backends status-only) and the documented future shift to client-side probing. - Homepage Design Grilling.md (new): the decision log — settled Q1-Q5 plus 38 open questions (Q6-Q43) across 10 categories, each with a recommendation. - docs/index.md: link the grilling page (satisfies the index-links-every-page test). - report/homepage-grilling-2026-08-22.html: self-contained terminal-TUI progress report (settled decisions, verified stack baseline, overnight processing, work threads, the open questions, and how to continue). Baseline recorded: Dankclaw fully up (10/10); the Dankserver media stack is down (only Calibre-Web + the LLM are up; no .env on the target) — a separate thread. No homepage code built yet; the design is pending the operator's answers to Q6-Q43.
146 lines
6.1 KiB
Markdown
146 lines
6.1 KiB
Markdown
# Server App Configs
|
|
|
|
Podman deployment configuration for two homelab servers: Dankserver and Dankclaw.
|
|
|
|
This repository is the single source of truth for both hosts. It tracks the
|
|
container stacks and the LLM inference fleet. Edits flow through this repo,
|
|
then deploy to the targets with `scripts/deploy.sh` (one script per target
|
|
covers both workloads).
|
|
|
|
> 2026-08-22: the former `vllmScripts` repository (LLM fleet) is merged
|
|
> into this repo with its full git history. Its knowledge base now lives at
|
|
> [docs/LLM/index.md](LLM/index.md).
|
|
|
|
## Hosts
|
|
|
|
| Host | IP | Role | OS |
|
|
|------|----|------|----|
|
|
| Dankserver | 192.168.0.235 | Media & library stack | Ubuntu 24.04 |
|
|
| Dankclaw | 192.168.0.143 | AI, search & development stack | Ubuntu 26.04 |
|
|
|
|
## Stacks
|
|
|
|
- [[Dankserver Stack]] — RomM, Copyparty, Calibre, Calibre-Web, Caddy
|
|
- [[Dankclaw Stack]] — SearXNG (via Gluetun), ComfyUI, OpenWebUI, Hermes, Gitea, Grafana, Prometheus, Caddy
|
|
|
|
## Architecture
|
|
|
|
- [[Network Architecture]] — Caddy reverse proxy, hostname routing, Gluetun VPN path
|
|
- [[Storage Policy]] — bind mounts, data locations, ownership
|
|
- [[Deployment Flow]] — git-based deploy, target map, health checks
|
|
- [[Testing Policy]] — the test seams and how to run them
|
|
|
|
## Dankserver Services
|
|
|
|
- [[RomM]] — retro game manager
|
|
- [[RomM-Scraping]] — metadata providers, cover art, naming conventions
|
|
- [[Copyparty]] — file sharing and streaming
|
|
- [[Jellyfin]] — media server (movies, TV, music)
|
|
- [[Calibre]] — e-book library engine
|
|
- [[Calibre-Web]] — e-book web frontend
|
|
- [[ARR-Stack]] — automated media download overview
|
|
- [[sonarr]] — TV show management
|
|
- [[radarr]] — movie management
|
|
- [[lidarr]] — music management
|
|
- [[readarr]] — ebook/audiobook management
|
|
- [[prowlarr]] — indexer management
|
|
- [[qbittorrent]] — torrent download client
|
|
- [[mariadb]] — RomM database backend
|
|
- [[redis]] — RomM cache/queue backend
|
|
|
|
## Dankclaw Services
|
|
|
|
- [[SearXNG]] — privacy metasearch (VPN-routed)
|
|
- [[Gluetun]] — the VPN tunnel container
|
|
- [[Valkey]] — SearXNG cache and limiter store
|
|
- [[ComfyUI]] — node-based AI image generation (CPU)
|
|
- [[OpenWebUI]] — chat UI for local LLMs
|
|
- [[Hermes]] — the Nous Research agent
|
|
- [[Hermes-Dashboard]] — the Hermes web management UI (config, keys, sessions)
|
|
- [[Gitea]] — Git hosting (migrated)
|
|
- [[Postgres]] — Gitea database backend
|
|
|
|
## Infrastructure
|
|
|
|
- [[LAN-DNS]] — name resolution, dnsmasq, router DNS hand-off
|
|
- [[Caddy]] — reverse proxy and TLS
|
|
- [[Homepage]] — password-protected service index
|
|
- [[Homepage Design Grilling]] — homepage decision log and open questions
|
|
- [[Observability]] — Grafana, Prometheus, Loki, Alloy
|
|
- [[Grafana]] — dashboards
|
|
- [[Prometheus]] — metrics collection
|
|
- [[Node-Exporter]] — host metrics
|
|
- [[Loki]] — log storage
|
|
- [[Alloy]] — log shipping (replaces Promtail)
|
|
|
|
## Research
|
|
|
|
- [[Service Research Brief]] — consolidated subagent research behind these pages
|
|
- [[ComfyUI ROCm and Vulkan]] — live-verified GPU path for ComfyUI on Strix Halo
|
|
- [[Lemonade and sd.cpp]] — the ggml-family image-generation alternative
|
|
- [[Backblaze Integration]] — off-site backup plan (future)
|
|
- [[Jellyfin]] — media server research brief
|
|
- [[ARR-Stack]] — automated download stack research brief
|
|
|
|
## LLM Fleet
|
|
|
|
The LLM inference fleet on the two hosts. Full index:
|
|
[docs/LLM/index.md](LLM/index.md).
|
|
|
|
### Deployment and Topology
|
|
|
|
- [[deployment]] — unified deploy and update process for both servers
|
|
- [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
|
|
- [[ciru-activefpx-promptforge]] — the v3 CIRU PromptForge runtime on Dankclaw (active)
|
|
- [[kairic-edge]] — the retired Kairic Edge IU4 experiment (2026-08-22)
|
|
- [[dflash2-large-vulkan]] — the retired DFlash2 Vulkan deployment (2026-08-21)
|
|
- [[Dankserver System Specs]] — the upstream llama.cpp box hardware
|
|
- [[Dankclaw System Specs]] — the CIRU ROCmFPX box hardware
|
|
- [[Dankclaw Improvements]] — host-level changes on the CIRU box
|
|
|
|
### Benchmarks and Sizing
|
|
|
|
- [[frank-default-large-benchmark]] — backend/spec benchmark behind the old head
|
|
- [[frank-default-small-benchmark]] — the small-model benchmark suite
|
|
- [[Running Qwen3.6 35B A3B FP8 on Dankserver]] — Qwen3.6-35B-A3B hardware notes
|
|
- [[Running Qwen3.6 27B FP8 on Dankclaw]] — Qwen3.6-27B sizing on the iGPU
|
|
- [[qwen3.8-strix-optimizations]] — Strix Halo tuning notes
|
|
|
|
### Memory and Hardware
|
|
|
|
- [[RAM CPU Offloading in VLLM]] — KV cache swap between GPU VRAM and system RAM
|
|
- [[Hybrid CPU GPU Processing Dankserver]] — NVIDIA GPU compute with system RAM offload
|
|
- [[Shared Memory Architecture Dankclaw]] — AMD unified memory and ROCm configuration
|
|
- [[dankserver-vram-growth]] — VRAM/RAM growth behind the retired cuBLAS crash
|
|
- [[Quantization by Hardware Architecture]] — which quant format fits which GPU/CPU
|
|
|
|
### Retired Topology and History
|
|
|
|
- [[Qwen3.8 PP Deployment]] — the retired pipeline-parallel head + worker
|
|
- [[qwen3.8-spec-matrix]] — Qwen3.8-27B spec history (superseded by FastMTP)
|
|
- [[FastFlowLM NPU Inference]] — the retired FastFlowLM NPU endpoint
|
|
- [[DFlash DSpark Speculative Decoding]] — retired DFlash/DSpark drafting
|
|
- [[ling-3.0-flash-trial]] — the Ling-3.0-Flash trial runbook
|
|
- [[ling-3.0-flash-vllm-plan]] — the Ling-3.0-Flash vLLM plan (retired)
|
|
|
|
### vLLM Reference (historical)
|
|
|
|
- [[VLLM Overview]] — installation, CLI, API, architecture, quantization, parallelism
|
|
- [[VLLM Index]] — quick reference with commands, endpoints, and parameter table
|
|
- [[vllm_research_findings]] — research findings from the vLLM era
|
|
|
|
### Pipeline Parallelism (archive)
|
|
|
|
- [[Ethernet Bandwidth Math]] — the bandwidth budget for the PP pair
|
|
- [[Expected Performance]] — expected PP throughput
|
|
- [[llama.cpp RPC]] — the RPC transport between head and worker
|
|
- [[Mixed-Vendor Experiments]] — cross-vendor PP experiments
|
|
- [[Qwen3.6 27B Spec Methods]] — spec-decoding methods for the 27B
|
|
- [[Sample Script Set]] — reference scripts for the PP pair
|
|
- [[vLLM Pipeline Parallelism]] — vLLM's PP implementation
|
|
|
|
## See Also
|
|
|
|
- [[AGENTS.md]] — repository rules
|
|
- [docs/LLM/index.md](LLM/index.md) — the LLM fleet knowledge base
|