Files
serverAppConfigs/serverAppConfigs-docs/LLM/Dankclaw System Specs.md
T
Frank 219a097b39 docs(vault): one page per endpoint, forever -- 45 era pages fold into three
Every payload swap a live endpoint has ever run is now one row in that
endpoint's Eras table, with its rollback path in the same row. No per-attempt
page, no per-swap ledger, nowhere else.

- Added: LLM/frank-archon.md (radiance, 2x R9700 TP=2), LLM/frank-dragoon.md
  (halogen flash-server, 19 eras), LLM/frank-zealot.md (llama.cpp PrismML fork
  on the 3090). Each carries Current shape, Eras, Laws, wire contract, files.
- Deleted: 45 per-payload runbooks -- the frank-dragoon line (11 including the
  pre-name halogen/kingjones/kairic/CIRU/eemin/agentionai/dflash2 pages and the
  benchmark page), the frank-zealot line (llama.cpp/vLLM/ik_llama/SGLang eras),
  the frank-archon line (vLLM/FreeToken/R9V/llama.cpp/radiance eras), plus
  frank-medium, frank-npu and the ubatch/PCIe one-offs that owned nothing.
- Rewired: every wikilink and markdown-path reference to a folded page points
  at the endpoint page instead; the three Research see-also lists and the
  ubatch sweep's runbook link included. No anchored links existed in the set.
- Regenerated both index pages as pure locators -- one row, one clause, no
  numbers -- so the docs_completeness locator law holds for all 153 pages.

tests/docs_completeness.bats green: index links every page, no unresolved
links. The pages moved to .AGENTTRASH/20261018-doc-dedupe/LLM/ (gitignored,
and git history holds every byte).
2026-10-19 00:49:03 -07:00

7.0 KiB
Raw Blame History

type, description, tags, timestamp
type description tags timestamp
reference Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference.
llm
2026-09-03

Dankclaw System Specs

Server Overview

Dankclaw is an AMD APU + RTX 3090 inference host. It ran CIRU ROCmFPX llama.cpp inference through 2026-08-22 (frank-dragoon, retired). The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool. Today it serves frank-dragoon (halogen-flash-server 0.16.2 on the iGPU, port 7770) and frank-zealot (llama.cpp PrismML fork on the RTX 3090, port 7771).

Hardware Specifications

CPU

Property Value
Model AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
Architecture x86_64
Cores 16 (1 socket, 1 thread per core)
Max MHz 5187.50
Min MHz 625.00
NUMA Nodes 1 (node 0, 124129 MB — Node 0 MemTotal: 127108080 kB, read 2026-10-18)

GPU (Integrated)

Property Value
Model AMD Radeon 8060S (Strix Halo)
Device ID 0x1586
Architecture gfx1151 (Strix Halo)
GPU-Visible Memory ~114 GiB GTT aperture (the budget; mem_info_gtt_total = 122,402,963,456 B read 2026-10-18; rocm-smi's smaller SVM carve-out is not the budget)
Physical RAM 121 GiB visible to the OS (free -g total 121, read 2026-10-18) on a 128 GB part — 8 × 16 GB LPDDR5 (ling-3.0-flash-trial §hardware). The 64 GiB this page recorded as "corrected 2026-08-17" (from 32 GB) is stale

NPU

Property Value
Model AMD XDNA2 (Ryzen AI)
Rating 50 TOPS
Device /dev/accel/accel0
Driver amdxdna 0.7.0, in-tree — bound since 2026-10-18 (lspci -k -s c6:00.1 → Kernel driver in use: amdxdna; journal 2026-10-18 01:25:14 Initialized amdxdna_accel_driver 0.7.0 for 0000:c6:00.1 on minor 0)
Firmware 1.1.2.65 (/usr/lib/firmware/amdnpu/17f0_11/npu_7.sbin → npu.sbin.1.1.2.65.zst, loaded at boot 2026-10-18 01:25:13)
Runtime None installed. FastFlowLM 0.9.45 + XRT (installed 2026-08-16) was retired 2026-09-11 with the amd_iommu=off decision — see dankclaw-iommu-translation-off; the package remains at /home/dank/GitPackages/fastflowlm_0.9.45_ubuntu26.04_amd64.deb
Status Not in service — no NPU endpoint is deployed. The device itself is usable since the 2026-10-18 iommu=pt boot (/dev/accel/accel0 present, crw-rw---- root:render 261,0); Gitea issue #3 tracks enablement. See FastFlowLM NPU Inference

The NPU endpoint is retired (2026-09-11; frank-npu). The frank-zealot name now serves Ternary-Bonsai-2-27B-PQ2_0 on the RTX 3090 via the llama.cpp PrismML fork (see frank-zealot); the Gemma4-12B QAT rung it once pointed at is retired history (frank-zealot, 2026-09-17 → 10-01).

ROCm

Property Value
ROCk Module Loaded
Runtime Version 1.18
ROCm Version 7.2.4 system (/opt/rocm/.info/version = 7.2.4, read 2026-10-18). The TheRock 7.15 SDK that lived in the CIRU venv left the serving path when CIRU was retired 2026-08-22
Agent Name AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
GPU Arch gfx1151 (Strix Halo)
GPU Global Memory ~114 GiB GTT aperture (the budget)

Memory

Property Value
System RAM 121 GiB (shared CPU + GPU; free -g total 121, MemTotal 127108080 kB, 2026-10-18)
GPU-Visible (ROCm) ~114 GiB GTT aperture (mem_info_gtt_total 122,402,963,456 B — the budget)
Swap 64 GB /swap.img (swapon, 2026-10-18; free reports 63 GiB)
/dev/shm 61 GiB tmpfs (half of RAM, df /dev/shm, 2026-10-18)

Storage

Filesystem Size Used Avail Use%
/ (nvme0n1p2) 1.9T 1.4T 424G 77%

Network

Interface Type Speed IP Notes
eno1 onboard 2500 Mb/s (2.5 GbE) 192.168.0.143 (DHCP) Carried the RPC path to Dankserver during the 2026-08-17 pipeline-parallelism trial; no RPC listener runs today (ss -ltn shows no :50052, 2026-10-18). Default route via 192.168.0.1.
enx00e04cc2e1e5 USB-C to Ethernet adapter 1000 Mb/s 192.168.0.116 UNPLUGGED 2026-08-17. While present, the route to 192.168.0.235 went through this adapter (lower route metric), so all RPC traffic was capped at 1 GbE. See Pipeline Parallelism/Ethernet Bandwidth Math section 0.
docker0 bridge - 172.17.0.1 Usually down.

The L2 gateway/switch at 192.168.0.1 (MAC f0:4b:8a:65:c5:40) is at least 2.5 GbE-capable. Whether it is 10G-capable is unverified — check the device itself before buying 10G USB-C adapters; otherwise a direct cable between claw and server is required for 10G.

OS and Software

Property Value
OS Ubuntu 26.04 LTS (Resolute Raccoon)
Kernel 7.0.0-38-generic (uname -r, 2026-10-18)
Boot line iommu=pt since 2026-10-18 (/proc/cmdline, no amd_iommu token); eras before: amd_iommu=off 2026-09-11 → 10-18, IOMMU default-on before that — dankclaw-iommu-translation-off
Python 3.14.4 (system, python3 --version, 2026-10-18). The 3.12.13 CIRU venv left with that runtime (retired 2026-08-22)
CIRU runtime ciru-ai/ROCmFPX — retired 2026-08-22 (frank-dragoon); not the serving runtime
uv 0.12.8 (~/.local/bin/uv --version, 2026-10-18)

Runtime Relevance

  • Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
  • The GPU budget is the GTT aperture: ~114 GiB (mem_info_gtt_total in /sys/class/drm/card1/device/ = 122,402,963,456 B; card1 is the amdgpu iGPU, PCI_ID=1002:1586; llama-server --list-devices reports 116,732 MiB). rocm-smi's smaller SVM/dedicated carve-out is not the budget — the 2026-08 "64 GiB rocm-smi" lesson is stale. Do not use free or dmidecode for the GPU budget.
  • The active services are frank-dragoon on 7770 — halogen-flash-server 0.16.2 serving the native v2 abliterated .hgn in a rootless podman container (frank-dragoon) — and frank-zealot on 7771 (frank-zealot). The gufo v0.1.1 / UD-Q8_K_XL runtime this page once described is retired (2026-09-28 → 10-01, frank-dragoon); the gufo build tree is still on disk at /home/dank/GitPackages/gufo-v0.1.1/.
  • The gufo-era note that the active runtime links against the host ROCm (/opt/rocm → /etc/alternatives/rocm → 7.2.4) through its RPATH belongs to that retired source build. The serving runtimes do not depend on the host ROCm that way: halogen runs inside its digest-pinned image, and frank-zealot is a CUDA build on the 3090. The retired CIRU venv's TheRock 7.15 SDK (LD_LIBRARY_PATH) was never in the serving path either.
  • The retired vLLM venvs (/home/dank/vllm-venv, /home/dank/vllm-vk-venv) were moved to /home/dank/.AGENTTRASH/ on 2026-08-18.
  • 424 GB free on / (df -h, 2026-10-18) is ample for model storage.

See Also