Frank 7560d40543 patches: glm53-dflash-01 v4 -- all three SupportsEagle3 members on the wrapper
The v4 window boot named the real presence-check rule: isinstance against a
runtime_checkable Protocol walks __protocol_attrs__ (which includes members
inherited from BASE protocols) and getattr_static()s each one off the instance,
breaking on the first missing attribute. SupportsEagleBase declares
has_own_lm_head/has_own_embed_tokens as plain instance-var annotations, so
v3's bare supports_eagle3 flag still failed. Replicated in-image with stock
typing: flag-only class -> False; flag + the two base members -> True.

v4 declares all three on Glm5NextForCausalLM:
    supports_eagle3: ClassVar[Literal[True]] = True
    has_own_lm_head: bool = False
    has_own_embed_tokens: bool = False
(False is correct for the two: the wrapper delegates embed/lm_head to its
trunk. The MRO-safe attribute path is kept from v3.)

base 008eeaa2... -> patched 60f27aad..., apply-verified against the pinned
image (patch -p1 reproduces the sha256 and matches the mounted file).
2026-09-30 17:24:56 -07:00

Server App Configs

The single repository for the two homelab servers: the Podman container stacks and the LLM inference fleet. One repo, one checkout per host, one deploy script.

2026-08-22: the former vllmScripts repository (LLM fleet) is merged into this repo with its full git history. See AGENTS.md for the merge note.

Targets

Host User IP Podman stack LLM service LLM port
dankserver dank 192.168.0.235 media and library frank-medium (ROCmFPX llama.cpp, Qwen3.8-27B AGENT) 7770
dankclaw dank 192.168.0.143 AI, search, development, observability frank-large (gufo, Qwen3.8-27B UD-Q8_K_XL) 7770

Active Services

Service Host Hostname Port
RomM dankserver romm.dankserver.local 8085
Copyparty dankserver files.dankserver.local 3923
Calibre-Web dankserver books.dankserver.local 8083
frank-medium dankserver — (bare endpoint) 7770
SearXNG dankclaw search.dankclaw.local 8081
ComfyUI dankclaw comfyui.dankclaw.local 8188
OpenWebUI dankclaw chat.dankclaw.local 3000
Hermes dankclaw hermes.dankclaw.local 8090
Gitea dankclaw gitea.dankclaw.local 3001
Grafana dankclaw grafana.dankclaw.local 3002
Prometheus dankclaw prometheus.dankclaw.local 9090
frank-large dankclaw — (bare endpoint) 7770

Structure

  • dankserver/ — compose.yaml + Caddyfile + .env.example for the Dankserver stack
  • dankclaw/ — compose.yaml + Caddyfile + .env.example for the Dankclaw stack
  • shared/ — homepage, prometheus config, deploy helpers
  • scripts/ — deploy.sh and deploy-remote.sh (service-scoped deployment), the planner, LLM serve scripts, systemd units, env tunables, and bench harnesses
  • old/ — retired PP/NPU-era LLM scripts (reference only)
  • serverAppConfigs-docs/ — project knowledge base (Obsidian vault, wikilinks). serverAppConfigs-docs/LLM/ is the LLM fleet
  • tests/ — bats test suite (see Testing Policy)

Deployment

See serverAppConfigs-docs/Architecture/Deployment Flow.md and serverAppConfigs-docs/LLM/deployment.md. Run ./scripts/deploy.sh <dankclaw|dankserver> after committing changes. It plans and deploys only the changed services. Use --service NAME for an explicit single-service retry; inference is restarted only when its own files (or the shared chat template) changed.

Knowledge Base

The serverAppConfigs-docs/ directory is an Obsidian vault. Start at serverAppConfigs-docs/index.md. The LLM fleet knowledge base lives at serverAppConfigs-docs/LLM/index.md.

Testing

Run ./tests/run.sh before every push. See serverAppConfigs-docs/Architecture/Testing Policy.md.

S
Description
Podman deployment configs for Dankserver and Dankclaw
Readme
8.2 MiB
Languages
Shell 60.4%
Python 21%
HTML 6.2%
Jinja 3.9%
C++ 3.9%
Other 4.6%