Frank
d4024a9180
New runbook page serverAppConfigs-docs/LLM/frank-medium-rocmfpx.md records the hardware swap, the self-contained gfx1201 build, the measured layer-vs- tensor decision (llama-bench multi-device syntax gotcha included), the tensor-mode draft abort, served-path numbers, and the post-cleanup host ROCm posture. AGENTS.md, README, docs indexes, Dankserver System Specs, deployment/Hermes/OpenWebUI/Plex/Stack pages follow the rename; freetoken-frank-small is marked RETIRED and kingjones-q8agent SUPERSEDED. Work log entry added.
115 lines
3.8 KiB
Markdown
115 lines
3.8 KiB
Markdown
---
|
|
type: configuration
|
|
title: Dankserver System Specs
|
|
description: Dankserver hardware and OS state since the 2026-09-15 GPU swap (2x AMD Radeon AI PRO R9700, gfx1201) serving frank-medium.
|
|
tags:
|
|
- dankserver
|
|
- hardware
|
|
- r9700
|
|
- gfx1201
|
|
- rocm
|
|
timestamp: 2026-09-15
|
|
---
|
|
|
|
# Dankserver System Specs
|
|
|
|
## Server Overview
|
|
|
|
Dankserver is a media/library server and the `frank-medium` LLM host. The
|
|
host runs Ubuntu 26.04 (Resolute Raccoon). The RTX 3090 that served the
|
|
FreeToken/CUDA `frank-small` era was removed on 2026-09-15 and replaced with
|
|
two AMD Radeon AI PRO R9700 cards.
|
|
|
|
## Hardware Specifications
|
|
|
|
### CPU
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Architecture | x86_64 |
|
|
| Vendor | AuthenticAMD |
|
|
| Model | AMD Ryzen 7 7700X |
|
|
| Cores | 8 cores / 8 threads (1 socket, SMT off) |
|
|
| NUMA Nodes | 1 (node 0) |
|
|
|
|
### GPUs
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | 2x AMD Radeon AI PRO R9700 (Navi 48, DID 0x7551, rev c0) |
|
|
| Architecture | gfx1201 (RDNA4) |
|
|
| VRAM | 32,624 MiB each |
|
|
| Link | PCIe, no XGMI; different IOMMU groups |
|
|
| PCI | 03:00.0 and 0b:00.0 |
|
|
| iGPU | Raphael (gfx1036) at 10:00.0 — enumerates as ROCm device 2, hidden from HIP |
|
|
|
|
The RTX 3090 is gone; stale `nvidia-smi` binaries and the disabled NVIDIA
|
|
apt lists remain on disk but no NVIDIA PCI device exists.
|
|
|
|
### Memory
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| System RAM | 60 GiB |
|
|
| Swap | 63 GiB |
|
|
| /dev/shm | 32 GiB |
|
|
|
|
### Storage
|
|
|
|
| Filesystem | Size | Used | Avail | Use% |
|
|
|------------|------|------|-------|------|
|
|
| / (nvme0n1p2) | 915G | ~640G | ~280G | ~70% |
|
|
| /mnt/entropy (dm-0) | 91T | 86T | 910G | 99% |
|
|
|
|
Models live under `/home/dank/models`; the ROCmFPX build tree under
|
|
`/home/dank/GitPackages/charlie-ROCmFPX` with its self-contained ROCm 7.14
|
|
toolchain under `~/.local/share/rocm-7.14.0a20260624`.
|
|
|
|
### Network
|
|
|
|
| Interface | Type | Speed | IP | Notes |
|
|
|-----------|------|-------|----|-------|
|
|
| eno1 | onboard | 2500 Mb/s (2.5 GbE) | 192.168.0.235 (DHCP) | LLM endpoint (port 7770). Default route via 192.168.0.1. |
|
|
| enxe8ea6ab7ebca | USB-C class adapter | 2500 Mb/s | 192.168.0.252 | Unplugged since 2026-08-17. |
|
|
| wlp8s0 | WiFi | - | - | Unused (carrier down). |
|
|
|
|
### OS and Software
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| OS | Ubuntu 26.04 LTS (Resolute Raccoon) |
|
|
| Kernel | 7.0.0-30-generic |
|
|
| Python | 3.14.4 |
|
|
| ROCm userspace | Ubuntu 7.1 packages in /usr (hipcc 7.1.1, rocminfo, rocm-smi 7.1.1) |
|
|
| Serving stack | charlie12345/ROCmFPX llama.cpp with its own ROCm 7.14 toolchain (self-contained, RPATH-bundled) |
|
|
|
|
The stale AMD-repo ROCm 6.3.3 packages (167, `~24.04`-suffixed) that used to
|
|
hijack `libhsa-runtime64` were purged on 2026-09-15 — see
|
|
[[frank-medium-rocmfpx]].
|
|
|
|
### Active Services
|
|
|
|
The active inference service is `frank-medium.service`: charlie12345/ROCmFPX
|
|
llama-server on port 7770, layer-split across both R9700s with the MTP draft
|
|
head on ROCm1. See [[frank-medium-rocmfpx]]. The former
|
|
`frank-small.service` (FreeToken/CUDA) was retired with the GPU swap; its
|
|
unit is archived in `~/.AGENTTRASH/20260915-frank-small-retire/host-units/`.
|
|
The earlier PP worker (`frank-pp-worker.service`) was retired with the
|
|
2026-08-17 redo. See [[deployment]].
|
|
|
|
## Hardware Relevance
|
|
|
|
- 2x 32 GB VRAM: the 26.28 GiB Q8_0_ROCMFPX_AGENT checkpoint plus MTP draft
|
|
and a 131,072-token f16 KV cache fit comfortably; layer split gives each
|
|
card about half the layers and its own KV share.
|
|
- 60 GB system RAM is mostly headroom; nothing in the serving path is
|
|
CPU-resident.
|
|
- The iGPU is deliberately unused: `HIP_VISIBLE_DEVICES=0,1` keeps work off
|
|
the shared-memory Raphael device.
|
|
|
|
## See Also
|
|
|
|
- [[frank-medium-rocmfpx]] — the active serving runbook
|
|
- [[deployment]] — the deploy flow
|
|
- [[Shared Memory Architecture Dankclaw]] — for contrast, Dankclaw's unified memory
|