Files
serverAppConfigs/serverAppConfigs-docs/LLM/Dankclaw System Specs.md
T
Frank 04f4e2c6d4 docs(vault): strip restated fleet facts from 17 technique pages
Enforces "one fact, one owner": technique pages keep mechanism, laws, traps
and verdicts; per-endpoint shapes, digests and era measurements are cited to
the endpoint page that owns them.

Also repairs the four pointers the pass left empty (each verified against the
cited owner before landing):
- EMULATION dequant doubles host RAM (118 GiB -> ~238 GiB) -> [[frank-archon]]
- 12.11 tok/s flat 304 -> 16,095 tokens -> [[Tcclaviger Fork Ops]]
- bundled-head acceptance ladder 0.739/0.554/0.427/0.340 -> [[Qwen3.8 PP Deployment]]
- llama.cpp PR #23897 dedup provenance -> [[qwen3.8-spec-matrix]]

Replaces the retired-shape illustration in Llama Cpp Serving Sizing with the
owned MiMo Q5_K_M row (6.40 GiB payload -> 20,530 MiB used), and unwraps a
hard-wrapped [[Dankserver System Specs]] link that failed link integrity.

Orphan census over the diff: 0 numbers lost (comma-insensitive match against
the whole vault plus AGENTS.md).
2026-10-19 01:33:47 -07:00

7.4 KiB
Raw Blame History

type, description, tags, timestamp
type description tags timestamp
reference Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference.
llm
2026-09-03

Dankclaw System Specs

Server Overview

Dankclaw is an AMD APU + RTX 3090 inference host. It ran CIRU ROCmFPX llama.cpp inference through 2026-08-22 (frank-dragoon, retired). The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool. Today it serves frank-dragoon (halogen-flash-server 0.16.2 on the iGPU, port 7770) and frank-zealot (llama.cpp PrismML fork on the RTX 3090, port 7771).

Hardware Specifications

CPU

Property Value
Model AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
Architecture x86_64
Cores 16 (1 socket, 1 thread per core)
Max MHz 5187.50
Min MHz 625.00
NUMA Nodes 1 (node 0, 124129 MB — Node 0 MemTotal: 127108080 kB, read 2026-10-18)

GPU (Integrated)

Property Value
Model AMD Radeon 8060S (Strix Halo)
Device ID 0x1586
Architecture gfx1151 (Strix Halo)
GPU-Visible Memory ~114 GiB GTT aperture (the budget; mem_info_gtt_total = 122,402,963,456 B read 2026-10-18; rocm-smi's smaller SVM carve-out is not the budget)
Physical RAM 121 GiB visible to the OS (free -g total 121, read 2026-10-18) on a 128 GB part — 8 × 16 GB LPDDR5 (ling-3.0-flash-trial §hardware). The 64 GiB this page recorded as "corrected 2026-08-17" (from 32 GB) is stale

NPU

Property Value
Model AMD XDNA2 (Ryzen AI)
Rating 50 TOPS
Device /dev/accel/accel0
Driver amdxdna 0.7.0, in-tree — bound since 2026-10-18 (lspci -k -s c6:00.1 → Kernel driver in use: amdxdna; journal 2026-10-18 01:25:14 Initialized amdxdna_accel_driver 0.7.0 for 0000:c6:00.1 on minor 0)
Firmware 1.1.2.65 (/usr/lib/firmware/amdnpu/17f0_11/npu_7.sbin → npu.sbin.1.1.2.65.zst, loaded at boot 2026-10-18 01:25:13)
Runtime None installed. FastFlowLM 0.9.45 + XRT (installed 2026-08-16) was retired 2026-09-11 with the amd_iommu=off decision — see dankclaw-iommu-translation-off; the package remains at /home/dank/GitPackages/fastflowlm_0.9.45_ubuntu26.04_amd64.deb
Status Not in service — no NPU endpoint is deployed. The device itself is usable since the 2026-10-18 iommu=pt boot (/dev/accel/accel0 present, crw-rw---- root:render 261,0); Gitea issue #3 tracks enablement. See FastFlowLM NPU Inference

The NPU endpoint is retired (2026-09-11; frank-npu). The frank-zealot name now serves Ternary-Bonsai-2-27B-PQ2_0 on the RTX 3090 via the llama.cpp PrismML fork (see frank-zealot); the Gemma4-12B QAT rung it once pointed at is retired history (frank-zealot, 2026-09-17 → 10-01).

ROCm

Property Value
ROCk Module Loaded
Runtime Version 1.18
ROCm Version 7.2.4 system (/opt/rocm/.info/version = 7.2.4, read 2026-10-18). The TheRock 7.15 SDK that lived in the CIRU venv left the serving path when CIRU was retired 2026-08-22
Agent Name AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
GPU Arch gfx1151 (Strix Halo)
GPU Global Memory ~114 GiB GTT aperture (the budget)

Memory

Property Value
System RAM 121 GiB (shared CPU + GPU; free -g total 121, MemTotal 127108080 kB, 2026-10-18)
GPU-Visible (ROCm) ~114 GiB GTT aperture (mem_info_gtt_total 122,402,963,456 B — the budget)
Swap 64 GB /swap.img (swapon, 2026-10-18; free reports 63 GiB)
TTM page cap ttm.pages_limit = 29883536 (114 GiB of 4 KiB pages) and page_pool_size=29883536, persisted in /etc/modprobe.d/ttm.conf, applied live 2026-08-25 and re-read 2026-10-18 (/sys/module/ttm/parameters/pages_limit). The kernel default is half of RAM, so in the firmware-VGM era (~30 GiB visible) the cap was ~15 GiB and a 28 GB payload plus a 262k KV cache could not load — this is the row every other page should cite
/dev/shm 61 GiB tmpfs (half of RAM, df /dev/shm, 2026-10-18)

Storage

Filesystem Size Used Avail Use%
/ (nvme0n1p2) 1.9T 1.4T 424G 77%

Network

Interface Type Speed IP Notes
eno1 onboard 2500 Mb/s (2.5 GbE) 192.168.0.143 (DHCP) Carried the RPC path to Dankserver during the 2026-08-17 pipeline-parallelism trial; no RPC listener runs today (ss -ltn shows no :50052, 2026-10-18). Default route via 192.168.0.1.
enx00e04cc2e1e5 USB-C to Ethernet adapter 1000 Mb/s 192.168.0.116 UNPLUGGED 2026-08-17. While present, the route to 192.168.0.235 went through this adapter (lower route metric), so all RPC traffic was capped at 1 GbE. See Pipeline Parallelism/Ethernet Bandwidth Math section 0.
docker0 bridge - 172.17.0.1 Usually down.

The L2 gateway/switch at 192.168.0.1 (MAC f0:4b:8a:65:c5:40) is at least 2.5 GbE-capable. Whether it is 10G-capable is unverified — check the device itself before buying 10G USB-C adapters; otherwise a direct cable between claw and server is required for 10G.

OS and Software

Property Value
OS Ubuntu 26.04 LTS (Resolute Raccoon)
Kernel 7.0.0-38-generic (uname -r, 2026-10-18)
Boot line iommu=pt since 2026-10-18 (/proc/cmdline, no amd_iommu token); eras before: amd_iommu=off 2026-09-11 → 10-18, IOMMU default-on before that — dankclaw-iommu-translation-off
Python 3.14.4 (system, python3 --version, 2026-10-18). The 3.12.13 CIRU venv left with that runtime (retired 2026-08-22)
CIRU runtime ciru-ai/ROCmFPX — retired 2026-08-22 (frank-dragoon); not the serving runtime
uv 0.12.8 (~/.local/bin/uv --version, 2026-10-18)

Runtime Relevance

  • Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
  • The GPU budget is the GTT aperture: ~114 GiB (mem_info_gtt_total in /sys/class/drm/card1/device/ = 122,402,963,456 B; card1 is the amdgpu iGPU, PCI_ID=1002:1586; llama-server --list-devices reports 116,732 MiB). rocm-smi's smaller SVM/dedicated carve-out is not the budget — the 2026-08 "64 GiB rocm-smi" lesson is stale. Do not use free or dmidecode for the GPU budget.
  • The active services are frank-dragoon on 7770 — halogen-flash-server 0.16.2 serving the native v2 abliterated .hgn in a rootless podman container (frank-dragoon) — and frank-zealot on 7771 (frank-zealot). The gufo v0.1.1 / UD-Q8_K_XL runtime this page once described is retired (2026-09-28 → 10-01, frank-dragoon); the gufo build tree is still on disk at /home/dank/GitPackages/gufo-v0.1.1/.
  • The gufo-era note that the active runtime links against the host ROCm (/opt/rocm → /etc/alternatives/rocm → 7.2.4) through its RPATH belongs to that retired source build. The serving runtimes do not depend on the host ROCm that way: halogen runs inside its digest-pinned image, and frank-zealot is a CUDA build on the 3090. The retired CIRU venv's TheRock 7.15 SDK (LD_LIBRARY_PATH) was never in the serving path either.
  • The retired vLLM venvs (/home/dank/vllm-venv, /home/dank/vllm-vk-venv) were moved to /home/dank/.AGENTTRASH/ on 2026-08-18.
  • 424 GB free on / (df -h, 2026-10-18) is ample for model storage.

See Also