Files
serverAppConfigs/docs/Dankclaw System Specs.md
T

2.6 KiB

Dankclaw System Specs

Server Overview

Dankclaw is an AMD APU server for vLLM inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool.

Hardware Specifications

CPU

Property Value
Model AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
Architecture x86_64
Cores 16 (1 socket, 1 thread per core)
Max MHz 5187.50
Min MHz 625.00
NUMA Nodes 1 (node 0, 62909 MB)

GPU (Integrated)

Property Value
Model AMD Radeon 8060S (Strix Halo)
Device ID 0x1586
Architecture gfx1151 (Strix Halo)
GPU-Visible Memory 96 GiB (ROCm addressable range)
Physical RAM 30 GiB (shared CPU + GPU)

ROCm

Property Value
ROCk Module Loaded
Runtime Version 1.18
ROCm Version 7.2.4 (from AMD repos)
Agent Name AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
GPU Arch gfx1151 (Strix Halo)
GPU Global Memory 96 GiB (overcommitted, physical is 30 GiB)

Memory

Property Value
System RAM 30 GiB (shared CPU + GPU)
GPU-Visible (ROCm) 96 GiB (overcommitted addressable range)
Swap 8.0 GiB
/dev/shm ~15 GiB (half of RAM)

Storage

Filesystem Size Used Avail Use%
/ (nvme0n1p2) 1.9T 391G 1.4T 22%

OS and Software

Property Value
OS Ubuntu 26.04 LTS (Resolute Raccoon)
Kernel 7.0.0-29-generic
Python 3.14.4 (system), 3.12.13 (vLLM venv)
vLLM 0.26.0+rocm723
uv 0.12.2

VLLM Relevance

  • Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
  • ROCm reports 96 GiB GPU memory (overcommitted). Physical RAM is 30 GiB. vLLM sees 96 GiB and will try to use it. Set --gpu-memory-utilization conservatively (0.80-0.85) to avoid OOM when the OS needs memory.
  • Only 8 GiB swap. Set --swap-space conservatively (4-8 GiB).
  • ROCm 7.2.4 from AMD repos. vLLM ROCm support requires ROCm 6.3+.
  • Python 3.14.4 is very new. vLLM ROCm wheels target Python 3.12. Use a Python 3.12 venv.
  • Radeon 8060S falls under Ryzen AI MAX series (gfx1151). vLLM lists this as supported.
  • 1.4 TB free disk space is ample for model storage.
  • libmpi_cxx.so.40 is missing from the system. Install openmpi-bin or provide a workaround for torch MPI dependency.

See Also