Files
serverAppConfigs/serverAppConfigs-docs/Infrastructure/Prometheus.md
T
Frank 5829a0bfe8 docs: rename docs/ -> serverAppConfigs-docs/ per system-wide PROJECTNAME-docs convention
All in-repo path references (AGENTS.md, README, old scripts, report artifacts,
test code paths) rewritten in the same commit; focused-test map extended for
.gitignore, old/scripts/*, dankclaw/comfyui/*, and report/* per this repo's
own convention ('add one before committing'). Obsidian wikilinks are
title-based and unaffected.
2026-08-28 02:20:06 -07:00

1.7 KiB

Prometheus

Prometheus collects metrics from every service on Dankclaw by scraping their /metrics endpoints. It feeds the Grafana dashboards. The node-exporter containers may add podman/cgroup metrics for full host visibility.

Host: Dankclaw — Hostname: prometheus.dankclaw.local — Port: 9090 — Docs: https://prometheus.io/docs

Facts

Item Value
Image docker.io/prom/prometheus:latest
Port 9090 (host) → 9090 (container)
Config /etc/prometheus/prometheus.yml (bind mount)
Data volume TSDB
Retention --storage.tsdb.retention.time=30d

prometheus.yml Targets

scrape_configs:
  - job_name: "prometheus"
    static_configs:
      - targets: ["localhost:9090"]

  - job_name: "comfyui"
    static_configs:
      - targets: ["comfyui:8188"]

  - job_name: "node"
    static_configs:
      - targets: ["node-exporter:9100"]

Allow the /metrics endpoint on each service where the exporter exists. For services without a native exporter, use the Prometheus blackbox exporter (probe mode) to check up/down and latency.

Volumes

Container path Host path (convention)
/etc/prometheus /opt/prometheus/config
/prometheus /opt/prometheus/data

Healthcheck

Prometheus responds on /-/healthy with 200.

Gotchas

  • Keep scrapes modest for a small homelab; too many targets bloat the TSDB.
  • Use recording rules for heavy queries (see Grafana).
  • Set a retention policy or the data volume grows without bound.

See Also