docs: frank-medium runbook, fleet topology and client cutover
New runbook page serverAppConfigs-docs/LLM/frank-medium-rocmfpx.md records the hardware swap, the self-contained gfx1201 build, the measured layer-vs- tensor decision (llama-bench multi-device syntax gotcha included), the tensor-mode draft abort, served-path numbers, and the post-cleanup host ROCm posture. AGENTS.md, README, docs indexes, Dankserver System Specs, deployment/Hermes/OpenWebUI/Plex/Stack pages follow the rename; freetoken-frank-small is marked RETIRED and kingjones-q8agent SUPERSEDED. Work log entry added.
This commit is contained in:
1 parent
d53962fec5
commit
d4024a9180
15 files changed
+426
-80
No files matched your search
@@ -11,6 +11,47 @@ timestamp: 2026-09-14
|
||||
|
||||
# Bundle Change Log
|
||||
|
||||
## 2026-09-15 — frank-medium: Dankserver GPU swap (2x R9700), frank-small retired
|
||||
- The RTX 3090 left Dankserver; two AMD Radeon AI PRO R9700 cards (Navi 48,
|
||||
gfx1201, 32,624 MiB each) replaced it. FreeToken/CUDA cannot run there, so
|
||||
`frank-small` is retired and `frank-medium` took the :7770 endpoint.
|
||||
- Runtime: charlie12345/ROCmFPX llama.cpp `c49ebdb` built for **gfx1201** with
|
||||
the fork's self-contained ROCm 7.14 toolchain (TheRock nightly, RPATH-bundled
|
||||
libs) — the host's broken mixed ROCm (AMD-repo 6.3.3 hijacking libhsa via
|
||||
`/etc/ld.so.conf.d/10-rocm-opencl.conf`) is fully bypassed. Model:
|
||||
kingjones777/Qwen3.8-27B-ROCmFPX-Q8_0-AGENT-GGUF (ftype 115, 26.28 GiB) +
|
||||
Q4_0 MTP draft head; mmproj unused (vision stays on frank-large).
|
||||
- **Parallelism decision, measured not argued:** llama-bench with the correct
|
||||
multi-device syntax (`-dev ROCm0/ROCm1` — comma form silently benches each
|
||||
card separately): layer 1991/18.8 t/s (pp4096/tg128) vs tensor 271.8/26.3 vs
|
||||
single card 1160.9/19.4. Tensor's decode win costs a 7x prefill collapse
|
||||
(no RCCL → "meta-backend butterfly" allreduce); served with MTP, layer also
|
||||
wins decode (35.7–46.2 tok/s vs 28.7). Operator picked layer ("pipeline
|
||||
parallelism"); the data agrees on both axes. Draft head pinned to ROCm1
|
||||
(card holding the last target layers); under tensor mode an unpinned draft
|
||||
aborts the KV build (GGML_ASSERT(buffer) in ggml-backend.cpp).
|
||||
- Verified live before and after the systemd cutover: health ~18 s, MTP
|
||||
acceptance 60–69 %, cold 949-token prefill in 2036 ms, and **prefix caching
|
||||
works with the draft head** (turn 2 reprocessed 22 tokens, cache_n 945) —
|
||||
the model card's mtp-prompt-cache-fix.patch defect is already fixed in
|
||||
`c49ebdb` (`common_prompt_checkpoint::data_spec`).
|
||||
- Deploy: `deploy.sh dankserver --service frank-medium` (new
|
||||
`retire_root_llm_small()` archived the CUDA-era unit to
|
||||
`~/.AGENTTRASH/20260915-frank-small-retire/host-units/`); e2e gate 30/30
|
||||
including 11-admin (the blankpad→192.168.0.112 path issue has cleared).
|
||||
- Host cleanup (the "Both" half of the plan): purged 167 stale AMD-repo
|
||||
`~24.04` ROCm 6.3.3 packages, removed the radeon apt pin and the
|
||||
ld.so.conf hijack (staged in `~/.AGENTTRASH/20260915-rocm633-cleanup/`);
|
||||
`libhsa-runtime64` now resolves only to Ubuntu's ROCm 7.1 and `rocm-smi`
|
||||
7.1.1 (Ubuntu package) works. frank-medium unaffected (self-contained).
|
||||
- Client cutover: blankpad `models.yml`/`config.yml` renamed the model id to
|
||||
`frank-medium` (ctx 131072, maxTokens 32768); Hermes live config on Dankclaw
|
||||
repointed `dankserver-small` routes to `frank-medium`.
|
||||
- New: `/serverAppConfigs-docs/LLM/frank-medium-rocmfpx.md` runbook;
|
||||
updated AGENTS.md, README, docs indexes, Dankserver System Specs,
|
||||
deployment/Hermes/OpenWebUI/Plex/Stack pages; freetoken-frank-small and
|
||||
kingjones-q8agent marked retired/superseded.
|
||||
|
||||
## 2026-09-12 — Marreta content-cleaning proxy deployed on Dankclaw
|
||||
- Added `manualdousuario/marreta` (Laravel / `serversideup/php:8.4-fpm-nginx`)
|
||||
as a rootless Quadlet pair: `marreta` + `marreta-browser` (Lightpanda),
|
||||
|
||||
Reference in new issue
Block a user