Files
serverAppConfigs/serverAppConfigs-docs/LLM/Dankserver System Specs.md
T
Frank 55f87fcdce llm: retire the trio service names — fleet services renamed to frank-archon/frank-dragoon/frank-zealot
The 2026-10-09 wire aliases become the service names everywhere:
systemd units, serve scripts, env files and FRANK_* variables,
deploy-plan/deploy-remote service keys, container names, Prometheus
job names + alert rules, Grafana dashboard queries, bats seams,
runbook filenames, homepage/AGENTS lore, and historical prose.
Rollback tags renamed in lockstep. Residue in the tree: zero.
Retired frank-medium/small/npu names are history and stay.

Known casualty: scripts/patches/*.patch context lines were rewritten;
those retired-era vLLM-fork patches no longer apply byte-exact.
2026-10-10 17:03:14 -07:00

6.0 KiB

type, title, description, tags, timestamp
type title description tags timestamp
configuration Dankserver System Specs Dankserver hardware and OS state since the 2026-09-20 board swap (ASUS ProArt B850-Creator WiFi NEO, 2x AMD Radeon AI PRO R9700 gfx1201 on CPU lanes x8/x8) serving frank-medium.
dankserver
hardware
r9700
gfx1201
rocm
2026-09-20

Dankserver System Specs

Server Overview

Dankserver is a media/library server and the frank-medium LLM host. The host runs Ubuntu 26.04 (Resolute Raccoon). The RTX 3090 that served the FreeToken/CUDA frank-zealot era was removed on 2026-09-15 and replaced with two AMD Radeon AI PRO R9700 cards.

Hardware Specifications

Motherboard

Property Value
Board ASUS ProArt B850-Creator WiFi NEO (Rev 1.xx) — swapped in 2026-09-20
Previous ASUS TUF GAMING B650-E WIFI (card #2 was behind the chipset there; see Dual-R9700-Cooperation)
GPU lanes CPU GPP ports bifurcated x8/x8 at Gen5: PCIEX16(G5)_1 → 00:01.1, PCIEX16(G5)_2 → 00:01.3; ~31.5 GB/s per card
Atomic routing AtomicOpsCap: Routing+ on every bridge in both GPU chains, AtomicOpsCtl: ReqEn+ on both endpoints — the condition that ruled out TP=2 for the previous board
Free PCIEX16(G4) (chipset, x4), M.2_2, M.2_3
Occupied M.2 M.2_1 — boot NVMe (Samsung PM9C1a, DRAM-less), trained x2 at Gen5 (63 Gb/s ≈ 7.9 GB/s)
Onboard 2x Realtek RTL8126 5GbE, RTL8922AE WiFi 7, PROM21 SATA controller

CPU

Property Value
Architecture x86_64
Vendor AuthenticAMD
Model AMD Ryzen 7 7700X
Cores 8 cores / 16 threads (1 socket) — SMT is on; the BIOS defaults reset with the board swap. llama.cpp still runs --threads 8 --threads-batch 8, so this is headroom, not a change in the serving shape
NUMA Nodes 1 (node 0)

GPUs

Property Value
Model 2x AMD Radeon AI PRO R9700 (Navi 48, DID 0x7551, rev c0)
Architecture gfx1201 (RDNA4)
VRAM 32,624 MiB each (rocm-smi reports 34,208,743,424 B per card)
Link PCIe 5.0 x8 each (CPU GPP 00:01.1 / 00:01.3), no XGMI; separate IOMMU groups (15 and 20), ACS ReqRedir+ on both root ports, so P2P hairpins at the root complex
Atomic ops Routing+ on all four bridges per chain; ReqEn+ on both endpoints (CAP_EXP+28.w = 0x1440)
PCI 03:00.0 and 07:00.0 (were 03:00.0 / 0b:00.0 on the B650-E)
iGPU Raphael (gfx1036) at 11:00.0 — enumerates as ROCm device 2, hidden from HIP

The RTX 3090 is gone; stale nvidia-smi binaries and the disabled NVIDIA apt lists remain on disk but no NVIDIA PCI device exists.

Memory

Property Value
System RAM 246 GiB (upgraded for the Lucebox DeepSeek deployment of 2026-09-26; this page said 60 GiB until 2026-09-28 — a stale figure that survived the board swap)
Swap 63 GiB (/swapfile)
/dev/shm 32 GiB

Storage

Filesystem Size Used Avail Use%
/ (nvme0n1p2) 1.8T 927G ~822G ~54%
/mnt/entropy (dm-0) 91T 87T 244G 100% — full; do not plan model payload here

Models live under /home/dank/models; the serving build tree under /home/dank/GitPackages/llama.cpp-dflash2 (the older charlie-ROCmFPX tree is still on disk), both sharing the self-contained ROCm 7.14 nightly toolchain under ~/.local/share/rocm-7.14.0a20260624 — which also carries librccl.so.1 and hipcc, so an RCCL-backed rebuild needs no new host packages.

Network

Interface Type Speed IP Notes
eno1 onboard RTL8126 5GbE 2500 Mb/s (negotiated) 192.168.0.235, static LLM endpoint (port 7770). The address models.yml, Prometheus and Pi-hole all point at — preserved across the swap.
eno2 onboard RTL8126 5GbE, second port 2500 Mb/s 192.168.0.247, DHCP New since the swap: cabled, and it took the lower-metric default route (101, against eno1's 102). Two live addresses and two default routes for one host — either declare it or bring the link down.
wlp14s0 WiFi 7 (RTL8922AE) - - Renamed with the board (was wlp8s0); unused.

OS and Software

Property Value
OS Ubuntu 26.04 LTS (Resolute Raccoon)
Kernel 7.0.0-31-generic (iommu=pt)
Python 3.14.4
ROCm userspace Ubuntu 7.1 packages in /usr (hipcc 7.1.1, rocminfo, rocm-smi 7.1.1)
Serving stack mainline llama.cpp fb27a525 at ~/GitPackages/llama.cpp-dflash2/build-rdna4-rocm714, RPATH-bundled with the ROCm 7.14 nightly runtime

The stale AMD-repo ROCm 6.3.3 packages (167, ~24.04-suffixed) that used to hijack libhsa-runtime64 were purged on 2026-09-15 — see frank-medium-rocmfpx.

Active Services

The active inference service is frank-medium.service: mainline llama-server on port 7770, layer-split 32:33 across both R9700s with the DFlash2 drafter pinned to ROCm1. See frank-medium-llamacpp-dflash2. The former frank-zealot.service (FreeToken/CUDA) was retired with the 2026-09-15 GPU swap; its unit is archived in ~/.AGENTTRASH/20260915-frank-zealot-retire/host-units/, and the vllm-radiance replica trio in ~/.AGENTTRASH/20260916-vllm-radiance-retire/. See deployment.

Hardware Relevance

  • 2x 32 GB VRAM: the 27.0 GiB Q8_0 checkpoint plus the 1.06 GiB DFlash2 drafter and the f16 KV pool for 327,680 tokens fit with the split at 32:33; live headroom is ~6.3 GiB on ROCm0 and ~5.2 GiB on ROCm1, which is why a batch or context change needs a re-fit and not a guess.
  • 60 GB system RAM is mostly headroom; nothing in the serving path is CPU-resident.
  • The iGPU is deliberately unused: HIP_VISIBLE_DEVICES=0,1 keeps work off the shared-memory Raphael device.

See Also