rename frank-small → frank-secondary (Dankclaw llama.cpp :7771)
Cross-cutting rename of the current llama.cpp endpoint on the RTX 3090
(port 7771) from frank-small to frank-secondary:
- Service trio: scripts/{frank-small.env,frank-small.service,
serve-frank-small.sh,download-frank-small.sh} → frank-secondary.*
- Test: tests/frank_small_unit.bats → tests/frank_secondary_unit.bats
- Runbooks: serverAppConfigs-docs/LLM/frank-small-*.md →
frank-secondary-*.md (9 files); the FreeToken runbook stays
freetoken-frank-small.md (it documents the retired CUDA-era service)
- Identifiers: FRANK_SMALL→FRANK_SECONDARY, llm_small→llm_secondary,
LLM_SMALL_*→LLM_SECONDARY_*, deploy_llm_small→deploy_llm_secondary
- Historical references to the OLD frank-small (FreeToken/CUDA on the
3090, and the Dankserver service that became frank-medium) are
preserved verbatim — they describe what the service was called
at the time.
This commit is contained in:
1 parent
c71a3066c0
commit
87721ab0fe
87 files changed
+460
-460
No files matched your search
@@ -191,7 +191,7 @@ Ports 8880–8883 avoid the fleet's LLM ports (7770/7771).
|
||||
licenses (IndexTTS, Fish S2, XTTS v2). For a personal homelab voice, MIT /
|
||||
Apache-2.0 (Chatterbox, Qwen3-TTS, GLM-TTS, VoxCPM2) is the safe set.
|
||||
- **Co-locate on the 3090** with a low `--gpu-memory-utilization` (~0.35) so the
|
||||
TTS engine shares the card with frank-small; move to the R9700s only if TTS
|
||||
TTS engine shares the card with frank-secondary; move to the R9700s only if TTS
|
||||
throughput demand grows.
|
||||
- **Guard the endpoint like any other service:** if vhosted, it goes behind the
|
||||
Anubis → Authentik chain; non-browser clients (OMP's `curl`) must target the
|
||||
|
||||
Reference in new issue
Block a user