docs: frank-medium runbook, fleet topology and client cutover

New runbook page serverAppConfigs-docs/LLM/frank-medium-rocmfpx.md records
the hardware swap, the self-contained gfx1201 build, the measured layer-vs-
tensor decision (llama-bench multi-device syntax gotcha included), the
tensor-mode draft abort, served-path numbers, and the post-cleanup host ROCm
posture. AGENTS.md, README, docs indexes, Dankserver System Specs,
deployment/Hermes/OpenWebUI/Plex/Stack pages follow the rename;
freetoken-frank-small is marked RETIRED and kingjones-q8agent SUPERSEDED.
Work log entry added.
This commit is contained in:
Frank committed 2026-09-15 19:27:04 -07:00
1 parent d53962fec5
commit d4024a9180
15 files changed
+426 -80

No files matched your search

+41
View File
@@ -11,6 +11,47 @@ timestamp: 2026-09-14
# Bundle Change Log
## 2026-09-15 — frank-medium: Dankserver GPU swap (2x R9700), frank-small retired
- The RTX 3090 left Dankserver; two AMD Radeon AI PRO R9700 cards (Navi 48,
gfx1201, 32,624 MiB each) replaced it. FreeToken/CUDA cannot run there, so
`frank-small` is retired and `frank-medium` took the :7770 endpoint.
- Runtime: charlie12345/ROCmFPX llama.cpp `c49ebdb` built for **gfx1201** with
the fork's self-contained ROCm 7.14 toolchain (TheRock nightly, RPATH-bundled
libs) — the host's broken mixed ROCm (AMD-repo 6.3.3 hijacking libhsa via
`/etc/ld.so.conf.d/10-rocm-opencl.conf`) is fully bypassed. Model:
kingjones777/Qwen3.8-27B-ROCmFPX-Q8_0-AGENT-GGUF (ftype 115, 26.28 GiB) +
Q4_0 MTP draft head; mmproj unused (vision stays on frank-large).
- **Parallelism decision, measured not argued:** llama-bench with the correct
multi-device syntax (`-dev ROCm0/ROCm1` — comma form silently benches each
card separately): layer 1991/18.8 t/s (pp4096/tg128) vs tensor 271.8/26.3 vs
single card 1160.9/19.4. Tensor's decode win costs a 7x prefill collapse
(no RCCL → "meta-backend butterfly" allreduce); served with MTP, layer also
wins decode (35.7–46.2 tok/s vs 28.7). Operator picked layer ("pipeline
parallelism"); the data agrees on both axes. Draft head pinned to ROCm1
(card holding the last target layers); under tensor mode an unpinned draft
aborts the KV build (GGML_ASSERT(buffer) in ggml-backend.cpp).
- Verified live before and after the systemd cutover: health ~18 s, MTP
acceptance 60–69 %, cold 949-token prefill in 2036 ms, and **prefix caching
works with the draft head** (turn 2 reprocessed 22 tokens, cache_n 945) —
the model card's mtp-prompt-cache-fix.patch defect is already fixed in
`c49ebdb` (`common_prompt_checkpoint::data_spec`).
- Deploy: `deploy.sh dankserver --service frank-medium` (new
`retire_root_llm_small()` archived the CUDA-era unit to
`~/.AGENTTRASH/20260915-frank-small-retire/host-units/`); e2e gate 30/30
including 11-admin (the blankpad→192.168.0.112 path issue has cleared).
- Host cleanup (the "Both" half of the plan): purged 167 stale AMD-repo
`~24.04` ROCm 6.3.3 packages, removed the radeon apt pin and the
ld.so.conf hijack (staged in `~/.AGENTTRASH/20260915-rocm633-cleanup/`);
`libhsa-runtime64` now resolves only to Ubuntu's ROCm 7.1 and `rocm-smi`
7.1.1 (Ubuntu package) works. frank-medium unaffected (self-contained).
- Client cutover: blankpad `models.yml`/`config.yml` renamed the model id to
`frank-medium` (ctx 131072, maxTokens 32768); Hermes live config on Dankclaw
repointed `dankserver-small` routes to `frank-medium`.
- New: `/serverAppConfigs-docs/LLM/frank-medium-rocmfpx.md` runbook;
updated AGENTS.md, README, docs indexes, Dankserver System Specs,
deployment/Hermes/OpenWebUI/Plex/Stack pages; freetoken-frank-small and
kingjones-q8agent marked retired/superseded.
## 2026-09-12 — Marreta content-cleaning proxy deployed on Dankclaw
- Added `manualdousuario/marreta` (Laravel / `serversideup/php:8.4-fpm-nginx`)
as a rootless Quadlet pair: `marreta` + `marreta-browser` (Lightpanda),