Frank
93d1181fee
- Migrate all 127 non-reserved docs to OKF v0.1 frontmatter (type/description/tags/timestamp); fix 13 YAML issues, 2 duplicate-FM blocks, strip reserved-page FM - Restructure log.md to OKF (## YYYY-MM-DD, newest-first) - Fact-check against scripts/AGENTS.md ground truth: fix 6 false 'Active' banners on retired runbooks, 96->114 GiB GTT, deployment.md vs deploy-plan.py/deploy-remote.sh, Deployment Flow frank-medium=Quadlet, Calibre 9.9.0->9.15.0 + CVE-2025-7404 conflation, Copyparty v1.20.24, RomM 5.3.0 breaking change - Move *arr docs to new FrankBook-Pro/ section (git mv, link-safe) - Write active runbook bodies from ground truth (frank-large, frank-small) - Add 3 research briefs + HTML report: Local TTS and Voice Cloning, AI Job Search and Resume Tools, Most Popular Self-Hosted AI Apps (Jun-Sep 2026) - Add upstream-version rows to ComfyUI/OpenWebUI/Hermes app docs - All 336 tests pass; 136 pages, 0 unresolved wikilinks
115 lines
4.7 KiB
Markdown
115 lines
4.7 KiB
Markdown
---
|
|
type: reference
|
|
description: "Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference."
|
|
tags:
|
|
- llm
|
|
timestamp: 2026-09-03
|
|
---
|
|
|
|
# Dankclaw System Specs
|
|
|
|
## Server Overview
|
|
|
|
Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool.
|
|
## Hardware Specifications
|
|
|
|
### CPU
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S |
|
|
| Architecture | x86_64 |
|
|
| Cores | 16 (1 socket, 1 thread per core) |
|
|
| Max MHz | 5187.50 |
|
|
| Min MHz | 625.00 |
|
|
| NUMA Nodes | 1 (node 0, 31213 MB) |
|
|
|
|
### GPU (Integrated)
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | AMD Radeon 8060S (Strix Halo) |
|
|
| Device ID | 0x1586 |
|
|
| Architecture | gfx1151 (Strix Halo) |
|
|
| GPU-Visible Memory | ~114 GiB GTT aperture (the budget; `gtt_total`; rocm-smi's smaller SVM carve-out is not the budget) |
|
|
| Physical RAM | 64 GiB (61 GiB visible; upgraded from 32 GB, corrected 2026-08-17) |
|
|
|
|
### NPU
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | AMD XDNA2 (Ryzen AI) |
|
|
| Rating | 50 TOPS |
|
|
| Device | /dev/accel/accel0 |
|
|
| Driver | amdxdna 0.7 (in-tree, kernel 7.0.0-29-generic) |
|
|
| Firmware | 1.1.2.65 |
|
|
| Runtime | FastFlowLM 0.9.45 + XRT (installed 2026-08-16; **retired 2026-09-11** with the `amd_iommu=off` decision) |
|
|
| Status | Not in service. Research only. See [[FastFlowLM NPU Inference]] |
|
|
|
|
The NPU is retired (2026-09-11). The `frank-small` name now serves Gemma4-12B QAT on the RTX 3090 via llama.cpp (see [[frank-small-gemma4-12b]]).
|
|
|
|
### ROCm
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| ROCk Module | Loaded |
|
|
| Runtime Version | 1.18 |
|
|
| ROCm Version | 7.2.4 system (/opt/rocm) + TheRock 7.15 SDK in the CIRU venv (used for the runtime) |
|
|
| Agent Name | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S |
|
|
| GPU Arch | gfx1151 (Strix Halo) |
|
|
| GPU Global Memory | ~114 GiB GTT aperture (the budget) |
|
|
|
|
### Memory
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| System RAM | 64 GiB (shared CPU + GPU; 61 GiB visible) |
|
|
| GPU-Visible (ROCm) | ~114 GiB GTT aperture (the budget) |
|
|
| Swap | 8.0 GiB |
|
|
| /dev/shm | ~15 GiB (half of RAM) |
|
|
|
|
### Storage
|
|
|
|
| Filesystem | Size | Used | Avail | Use% |
|
|
|------------|------|------|-------|------|
|
|
| / (nvme0n1p2) | 1.9T | 1.3T | 545G | 70% |
|
|
|
|
### Network
|
|
|
|
| Interface | Type | Speed | IP | Notes |
|
|
|-----------|------|-------|----|-------|
|
|
| eno1 | onboard | 2500 Mb/s (2.5 GbE) | 192.168.0.143 (DHCP) | Carries the RPC path to Dankserver since 2026-08-17. Default route via 192.168.0.1. |
|
|
| enx00e04cc2e1e5 | USB-C to Ethernet adapter | 1000 Mb/s | 192.168.0.116 | UNPLUGGED 2026-08-17. While present, the route to 192.168.0.235 went through this adapter (lower route metric), so all RPC traffic was capped at 1 GbE. See [[Pipeline Parallelism/Ethernet Bandwidth Math]] section 0. |
|
|
| docker0 | bridge | - | 172.17.0.1 | Usually down. |
|
|
|
|
The L2 gateway/switch at 192.168.0.1 (MAC f0:4b:8a:65:c5:40) is at
|
|
least 2.5 GbE-capable. Whether it is 10G-capable is unverified — check
|
|
the device itself before buying 10G USB-C adapters; otherwise a direct
|
|
cable between claw and server is required for 10G.
|
|
|
|
### OS and Software
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| OS | Ubuntu 26.04 LTS (Resolute Raccoon) |
|
|
| Kernel | 7.0.0-29-generic |
|
|
| Python | 3.14.4 (system), 3.12.13 (CIRU venv) |
|
|
| CIRU runtime | ciru-ai/ROCmFPX v2.3 (llama-server, ROCm 7.15 SDK) |
|
|
| uv | 0.12.2 |
|
|
|
|
## Runtime Relevance
|
|
|
|
- Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
|
|
- The GPU budget is the GTT aperture: ~114 GiB (`gtt_total` in `/sys/class/drm/card1/device/`; `llama-server --list-devices` reports 116,732 MiB). rocm-smi's smaller SVM/dedicated carve-out is **not** the budget — the 2026-08 "64 GiB rocm-smi" lesson is stale. Do not use `free` or `dmidecode` for the GPU budget.
|
|
- The active service is `frank-large` on port 7770: stock llama.cpp (the unsloth b11030 prebuilt) serving unsloth/Qwen3.8-27B-GGUF:UD-Q8_K_XL (27B dense, q8_0 KV, DFlash2 drafter). See [[frank-large-unsloth-qwen38-27b-q8xl]].
|
|
- The active runtime (the unsloth b11030 prebuilt) **bundles its own ROCm runtime** next to the binary (`RPATH=$ORIGIN/../lib`), so it has no host SDK gate — the system ROCm 7.2.4 is not on its path. The retired CIRU venv's TheRock 7.15 SDK (`LD_LIBRARY_PATH`) is no longer in the serving path.
|
|
- The retired vLLM venvs (`/home/dank/vllm-venv`, `/home/dank/vllm-vk-venv`) were moved to `/home/dank/.AGENTTRASH/` on 2026-08-18.
|
|
- 1.1 TB free disk space is ample for model storage.
|
|
|
|
## See Also
|
|
|
|
- [[ciru-activefpx-promptforge]]
|
|
- [[Shared Memory Architecture Dankclaw]]
|
|
- [[frank-redo-2026-08-17]]
|
|
- [[FastFlowLM NPU Inference]]
|