Files

T

Frank cdae928f37 Homepage: settle design (grilling Q1-Q5), log open questions Q6-Q43, progress report

- Homepage.md: rewritten to the settled design (single site, user + /admin/
  pages, server-side status.json via a 3-min systemd-timer checker, terminal
  TUI theme). Added mermaid diagrams: site structure, status states, checker
  flow. Recorded the classification (user vs admin; *arr excluded; LLM admin;
  backends status-only) and the documented future shift to client-side probing.
- Homepage Design Grilling.md (new): the decision log — settled Q1-Q5 plus 38
  open questions (Q6-Q43) across 10 categories, each with a recommendation.
- docs/index.md: link the grilling page (satisfies the index-links-every-page test).
- report/homepage-grilling-2026-08-22.html: self-contained terminal-TUI progress
  report (settled decisions, verified stack baseline, overnight processing, work
  threads, the open questions, and how to continue).

Baseline recorded: Dankclaw fully up (10/10); the Dankserver media stack is down
(only Calibre-Web + the LLM are up; no .env on the target) — a separate thread.
No homepage code built yet; the design is pending the operator's answers to Q6-Q43.

2026-08-23 02:59:48 -07:00

6.1 KiB

Raw Blame History

Server App Configs

Podman deployment configuration for two homelab servers: Dankserver and Dankclaw.

This repository is the single source of truth for both hosts. It tracks the container stacks and the LLM inference fleet. Edits flow through this repo, then deploy to the targets with scripts/deploy.sh (one script per target covers both workloads).

2026-08-22: the former vllmScripts repository (LLM fleet) is merged into this repo with its full git history. Its knowledge base now lives at docs/LLM/index.md.

Hosts

Host	IP	Role	OS
Dankserver	192.168.0.235	Media & library stack	Ubuntu 24.04
Dankclaw	192.168.0.143	AI, search & development stack	Ubuntu 26.04

Stacks

Dankserver Stack — RomM, Copyparty, Calibre, Calibre-Web, Caddy
Dankclaw Stack — SearXNG (via Gluetun), ComfyUI, OpenWebUI, Hermes, Gitea, Grafana, Prometheus, Caddy

Architecture

Network Architecture — Caddy reverse proxy, hostname routing, Gluetun VPN path
Storage Policy — bind mounts, data locations, ownership
Deployment Flow — git-based deploy, target map, health checks
Testing Policy — the test seams and how to run them

Dankserver Services

RomM — retro game manager
RomM-Scraping — metadata providers, cover art, naming conventions
Copyparty — file sharing and streaming
Jellyfin — media server (movies, TV, music)
Calibre — e-book library engine
Calibre-Web — e-book web frontend
ARR-Stack — automated media download overview
sonarr — TV show management
radarr — movie management
lidarr — music management
readarr — ebook/audiobook management
prowlarr — indexer management
qbittorrent — torrent download client
mariadb — RomM database backend
redis — RomM cache/queue backend

Dankclaw Services

SearXNG — privacy metasearch (VPN-routed)
Gluetun — the VPN tunnel container
Valkey — SearXNG cache and limiter store
ComfyUI — node-based AI image generation (CPU)
OpenWebUI — chat UI for local LLMs
Hermes — the Nous Research agent
Hermes-Dashboard — the Hermes web management UI (config, keys, sessions)
Gitea — Git hosting (migrated)
Postgres — Gitea database backend

Infrastructure

LAN-DNS — name resolution, dnsmasq, router DNS hand-off
Caddy — reverse proxy and TLS
Homepage — password-protected service index
Homepage Design Grilling — homepage decision log and open questions
Observability — Grafana, Prometheus, Loki, Alloy
Grafana — dashboards
Prometheus — metrics collection
Node-Exporter — host metrics
Loki — log storage
Alloy — log shipping (replaces Promtail)

Research

Service Research Brief — consolidated subagent research behind these pages
ComfyUI ROCm and Vulkan — live-verified GPU path for ComfyUI on Strix Halo
Lemonade and sd.cpp — the ggml-family image-generation alternative
Backblaze Integration — off-site backup plan (future)
Jellyfin — media server research brief
ARR-Stack — automated download stack research brief

LLM Fleet

The LLM inference fleet on the two hosts. Full index: docs/LLM/index.md.

Deployment and Topology

deployment — unified deploy and update process for both servers
frank-redo-2026-08-17 — the 2026-08-17 topology change
ciru-activefpx-promptforge — the v3 CIRU PromptForge runtime on Dankclaw (active)
kairic-edge — the retired Kairic Edge IU4 experiment (2026-08-22)
dflash2-large-vulkan — the retired DFlash2 Vulkan deployment (2026-08-21)
Dankserver System Specs — the upstream llama.cpp box hardware
Dankclaw System Specs — the CIRU ROCmFPX box hardware
Dankclaw Improvements — host-level changes on the CIRU box

Benchmarks and Sizing

frank-default-large-benchmark — backend/spec benchmark behind the old head
frank-default-small-benchmark — the small-model benchmark suite
Running Qwen3.6 35B A3B FP8 on Dankserver — Qwen3.6-35B-A3B hardware notes
Running Qwen3.6 27B FP8 on Dankclaw — Qwen3.6-27B sizing on the iGPU
qwen3.8-strix-optimizations — Strix Halo tuning notes

Memory and Hardware

RAM CPU Offloading in VLLM — KV cache swap between GPU VRAM and system RAM
Hybrid CPU GPU Processing Dankserver — NVIDIA GPU compute with system RAM offload
Shared Memory Architecture Dankclaw — AMD unified memory and ROCm configuration
dankserver-vram-growth — VRAM/RAM growth behind the retired cuBLAS crash
Quantization by Hardware Architecture — which quant format fits which GPU/CPU

Retired Topology and History

Qwen3.8 PP Deployment — the retired pipeline-parallel head + worker
qwen3.8-spec-matrix — Qwen3.8-27B spec history (superseded by FastMTP)
FastFlowLM NPU Inference — the retired FastFlowLM NPU endpoint
DFlash DSpark Speculative Decoding — retired DFlash/DSpark drafting
ling-3.0-flash-trial — the Ling-3.0-Flash trial runbook
ling-3.0-flash-vllm-plan — the Ling-3.0-Flash vLLM plan (retired)

vLLM Reference (historical)

VLLM Overview — installation, CLI, API, architecture, quantization, parallelism
VLLM Index — quick reference with commands, endpoints, and parameter table
vllm_research_findings — research findings from the vLLM era

Pipeline Parallelism (archive)

Ethernet Bandwidth Math — the bandwidth budget for the PP pair
Expected Performance — expected PP throughput
llama.cpp RPC — the RPC transport between head and worker
Mixed-Vendor Experiments — cross-vendor PP experiments
Qwen3.6 27B Spec Methods — spec-decoding methods for the 27B
Sample Script Set — reference scripts for the PP pair
vLLM Pipeline Parallelism — vLLM's PP implementation

6.1 KiB Raw Blame History