rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)
Cross-cutting rename of the current llama.cpp endpoint on the RTX 3090
(port 7771) from frank-small to frank-secondary:
- Service trio: scripts/{frank-small.env,frank-small.service,
serve-frank-small.sh,download-frank-small.sh} → frank-secondary.*
- Test: tests/frank_small_unit.bats → tests/frank_secondary_unit.bats
- Runbooks: serverAppConfigs-docs/LLM/frank-small-*.md →
frank-secondary-*.md (9 files); the FreeToken runbook stays
freetoken-frank-small.md (it documents the retired CUDA-era service)
- Identifiers: FRANK_SMALL→FRANK_SECONDARY, llm_small→llm_secondary,
LLM_SMALL_*→LLM_SECONDARY_*, deploy_llm_small→deploy_llm_secondary
- Historical references to the OLD frank-small (FreeToken/CUDA on the
3090, and the Dankserver service that became frank-medium) are
preserved verbatim — they describe what the service was called
at the time.
This commit is contained in:
@@ -32,7 +32,7 @@ scrape_configs:
|
||||
# bridge container, and on this netavark host a container can only reach the
|
||||
# host's LAN IP at a PUBLISHED port — node-exporter's net=host bind on
|
||||
# 192.168.0.143:9100 is refused by construction (the same rule that sends
|
||||
# frank-large and frank-small to the gateway below). node-dankserver is a
|
||||
# frank-large and frank-secondary to the gateway below). node-dankserver is a
|
||||
# different machine, so its LAN address works.
|
||||
- job_name: "node-dankclaw"
|
||||
static_configs:
|
||||
@@ -79,20 +79,20 @@ scrape_configs:
|
||||
# this container, not the guarded vhosts: these are machine clients and
|
||||
# Prometheus cannot solve an Anubis challenge.
|
||||
#
|
||||
# One metric namespace: llamacpp:* — frank-large, frank-small and
|
||||
# One metric namespace: llamacpp:* — frank-large, frank-secondary and
|
||||
# frank-primary, all llama.cpp with /metrics (the family verified from
|
||||
# /metrics on 2026-09-16 and 2026-09-20) and all exporting
|
||||
# requests_deferred (the queue depth, the only form llama.cpp shows the
|
||||
# capacity wall in), spec_decode_num_drafts_total, tokens_predicted_total,
|
||||
# and the prompt_tokens_cached_total / prompt_tokens_total reuse pair.
|
||||
#
|
||||
# frank-large and frank-small are scraped over host.containers.internal,
|
||||
# frank-large and frank-secondary are scraped over host.containers.internal,
|
||||
# not their own LAN addresses: this Prometheus is a bridge-networked
|
||||
# container (Network=dankclaw_default), and on this netavark host a
|
||||
# container can only reach the host's LAN IP at a PUBLISHED port — a
|
||||
# host-process bind like llama-server's 0.0.0.0:7770 is refused at
|
||||
# 192.168.0.143:7770 while it answers at 169.254.1.2:7770. That is
|
||||
# why frank-small was red here for days (up{job="frank-small"} == 0,
|
||||
# why frank-secondary was red here for days (up{job="frank-secondary"} == 0,
|
||||
# "dial tcp 192.168.0.143:7771") even though the endpoint was healthy and
|
||||
# exporting: the target address was unreachable by construction, not the
|
||||
# service down. Same host, same rule, so both local endpoints use the
|
||||
@@ -105,12 +105,12 @@ scrape_configs:
|
||||
# plus radiance:* families, a different namespace — hence the separate
|
||||
# job below, not a re-add to the llamacpp pair. The netavark quirk above
|
||||
# is same-host only; plain LAN routing REACHES 192.168.0.235:7770.
|
||||
- job_name: "frank-small"
|
||||
- job_name: "frank-secondary"
|
||||
metrics_path: "/metrics"
|
||||
static_configs:
|
||||
- targets: ["host.containers.internal:7771"]
|
||||
labels:
|
||||
service: frank-small
|
||||
service: frank-secondary
|
||||
|
||||
- job_name: "frank-large"
|
||||
metrics_path: "/metrics"
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Alerting and recording rules for the LLM fleet.
|
||||
#
|
||||
# One metric namespace: llamacpp:* — frank-small and frank-large, both
|
||||
# One metric namespace: llamacpp:* — frank-secondary and frank-large, both
|
||||
# llama.cpp with /metrics (the family verified from /metrics on 2026-09-16
|
||||
# and 2026-09-20). frank-primary LEFT the family 2026-10-05: FreeToken (the
|
||||
# PR587 ROCm engine) has no /metrics endpoint, so its scrape job was
|
||||
@@ -110,8 +110,8 @@ groups:
|
||||
annotations:
|
||||
summary: "{{ $labels.job }}: scrape target down for 2 minutes"
|
||||
description: >-
|
||||
Prometheus cannot reach the LLM endpoint. frank-small and
|
||||
Prometheus cannot reach the LLM endpoint. frank-secondary and
|
||||
frank-large are root units on Dankclaw: `systemctl is-active
|
||||
frank-small` / `frank-large`. Both scraped endpoints export
|
||||
frank-secondary` / `frank-large`. Both scraped endpoints export
|
||||
the llamacpp:* family. (frank-primary left the scrape set
|
||||
2026-10-05 — FreeToken exports no /metrics.)
|
||||
|
||||
Reference in New Issue
Block a user