Files
serverAppConfigs/serverAppConfigs-docs/LLM/Dankclaw System Specs.md
T
Frank 55f87fcdce llm: retire the trio service names — fleet services renamed to frank-archon/frank-dragoon/frank-zealot
The 2026-10-09 wire aliases become the service names everywhere:
systemd units, serve scripts, env files and FRANK_* variables,
deploy-plan/deploy-remote service keys, container names, Prometheus
job names + alert rules, Grafana dashboard queries, bats seams,
runbook filenames, homepage/AGENTS lore, and historical prose.
Rollback tags renamed in lockstep. Residue in the tree: zero.
Retired frank-medium/small/npu names are history and stay.

Known casualty: scripts/patches/*.patch context lines were rewritten;
those retired-era vLLM-fork patches no longer apply byte-exact.
2026-10-10 17:03:14 -07:00

4.9 KiB

type, description, tags, timestamp
type description tags timestamp
reference Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference.
llm
2026-09-03

Dankclaw System Specs

Server Overview

Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool.

Hardware Specifications

CPU

Property Value
Model AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
Architecture x86_64
Cores 16 (1 socket, 1 thread per core)
Max MHz 5187.50
Min MHz 625.00
NUMA Nodes 1 (node 0, 31213 MB)

GPU (Integrated)

Property Value
Model AMD Radeon 8060S (Strix Halo)
Device ID 0x1586
Architecture gfx1151 (Strix Halo)
GPU-Visible Memory ~114 GiB GTT aperture (the budget; gtt_total; rocm-smi's smaller SVM carve-out is not the budget)
Physical RAM 64 GiB (61 GiB visible; upgraded from 32 GB, corrected 2026-08-17)

NPU

Property Value
Model AMD XDNA2 (Ryzen AI)
Rating 50 TOPS
Device /dev/accel/accel0
Driver amdxdna 0.7 (in-tree, kernel 7.0.0-29-generic)
Firmware 1.1.2.65
Runtime FastFlowLM 0.9.45 + XRT (installed 2026-08-16; retired 2026-09-11 with the amd_iommu=off decision)
Status Not in service. Research only. See FastFlowLM NPU Inference

The NPU is retired (2026-09-11). The frank-zealot name now serves Gemma4-12B QAT on the RTX 3090 via llama.cpp (see frank-zealot-gemma4-12b).

ROCm

Property Value
ROCk Module Loaded
Runtime Version 1.18
ROCm Version 7.2.4 system (/opt/rocm) + TheRock 7.15 SDK in the CIRU venv (used for the runtime)
Agent Name AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
GPU Arch gfx1151 (Strix Halo)
GPU Global Memory ~114 GiB GTT aperture (the budget)

Memory

Property Value
System RAM 64 GiB (shared CPU + GPU; 61 GiB visible)
GPU-Visible (ROCm) ~114 GiB GTT aperture (the budget)
Swap 8.0 GiB
/dev/shm ~15 GiB (half of RAM)

Storage

Filesystem Size Used Avail Use%
/ (nvme0n1p2) 1.9T 1.3T 545G 70%

Network

Interface Type Speed IP Notes
eno1 onboard 2500 Mb/s (2.5 GbE) 192.168.0.143 (DHCP) Carries the RPC path to Dankserver since 2026-08-17. Default route via 192.168.0.1.
enx00e04cc2e1e5 USB-C to Ethernet adapter 1000 Mb/s 192.168.0.116 UNPLUGGED 2026-08-17. While present, the route to 192.168.0.235 went through this adapter (lower route metric), so all RPC traffic was capped at 1 GbE. See Pipeline Parallelism/Ethernet Bandwidth Math section 0.
docker0 bridge - 172.17.0.1 Usually down.

The L2 gateway/switch at 192.168.0.1 (MAC f0:4b:8a:65:c5:40) is at least 2.5 GbE-capable. Whether it is 10G-capable is unverified — check the device itself before buying 10G USB-C adapters; otherwise a direct cable between claw and server is required for 10G.

OS and Software

Property Value
OS Ubuntu 26.04 LTS (Resolute Raccoon)
Kernel 7.0.0-29-generic
Python 3.14.4 (system), 3.12.13 (CIRU venv)
CIRU runtime ciru-ai/ROCmFPX v2.3 (llama-server, ROCm 7.15 SDK)
uv 0.12.2

Runtime Relevance

  • Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
  • The GPU budget is the GTT aperture: ~114 GiB (gtt_total in /sys/class/drm/card1/device/; llama-server --list-devices reports 116,732 MiB). rocm-smi's smaller SVM/dedicated carve-out is not the budget — the 2026-08 "64 GiB rocm-smi" lesson is stale. Do not use free or dmidecode for the GPU budget.
  • The active service is frank-dragoon on port 7770: gufo (gufo-org/gufo) v0.1.1, the Strix Halo inference engine, built from source at /home/dank/GitPackages/gufo-v0.1.1/, serving unsloth/Qwen3.8-27B-GGUF:UD-Q8_K_XL (27B dense, DFlash2 drafter). See frank-dragoon-gufo-qwen38-27b.
  • The active runtime links against the host ROCm (/opt/rocm → /etc/alternatives/rocm → 7.2.4) through its RPATH, so it needs the host HIP stack rather than a bundled one — the opposite of the retired llama.cpp prebuilt, which carried its own. Building it needs the ROCm dev packages that are installed, and two workarounds recorded in the runbook (drop librocwmma-dev; pin --gcc-install-dir to GCC 15). The retired CIRU venv's TheRock 7.15 SDK (LD_LIBRARY_PATH) is not in the serving path.
  • The retired vLLM venvs (/home/dank/vllm-venv, /home/dank/vllm-vk-venv) were moved to /home/dank/.AGENTTRASH/ on 2026-08-18.
  • 1.1 TB free disk space is ample for model storage.

See Also