82 lines
2.6 KiB
Markdown
82 lines
2.6 KiB
Markdown
# Dankclaw System Specs
|
|
|
|
## Server Overview
|
|
|
|
Dankclaw is an AMD APU server for vLLM inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same physical RAM pool.
|
|
## Hardware Specifications
|
|
|
|
### CPU
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S |
|
|
| Architecture | x86_64 |
|
|
| Cores | 16 (1 socket, 1 thread per core) |
|
|
| Max MHz | 5187.50 |
|
|
| Min MHz | 625.00 |
|
|
| NUMA Nodes | 1 (node 0, 62909 MB) |
|
|
|
|
### GPU (Integrated)
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| Model | AMD Radeon 8060S (Strix Halo) |
|
|
| Device ID | 0x1586 |
|
|
| Architecture | gfx1151 (Strix Halo) |
|
|
| GPU-Visible Memory | 96 GiB (ROCm addressable range) |
|
|
| Physical RAM | 30 GiB (shared CPU + GPU) |
|
|
|
|
### ROCm
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| ROCk Module | Loaded |
|
|
| Runtime Version | 1.18 |
|
|
| ROCm Version | 7.2.4 (from AMD repos) |
|
|
| Agent Name | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S |
|
|
| GPU Arch | gfx1151 (Strix Halo) |
|
|
| GPU Global Memory | 96 GiB (overcommitted, physical is 30 GiB) |
|
|
|
|
### Memory
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| System RAM | 30 GiB (shared CPU + GPU) |
|
|
| GPU-Visible (ROCm) | 96 GiB (overcommitted addressable range) |
|
|
| Swap | 8.0 GiB |
|
|
| /dev/shm | ~15 GiB (half of RAM) |
|
|
|
|
### Storage
|
|
|
|
| Filesystem | Size | Used | Avail | Use% |
|
|
|------------|------|------|-------|------|
|
|
| / (nvme0n1p2) | 1.9T | 391G | 1.4T | 22% |
|
|
|
|
### OS and Software
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| OS | Ubuntu 26.04 LTS (Resolute Raccoon) |
|
|
| Kernel | 7.0.0-29-generic |
|
|
| Python | 3.14.4 (system), 3.12.13 (vLLM venv) |
|
|
| vLLM | 0.26.0+rocm723 |
|
|
| uv | 0.12.2 |
|
|
|
|
## VLLM Relevance
|
|
|
|
- Unified memory eliminates separate VRAM limits. The GPU uses system RAM.
|
|
- ROCm reports 96 GiB GPU memory (overcommitted). Physical RAM is 30 GiB. vLLM sees 96 GiB and will try to use it. Set `--gpu-memory-utilization` conservatively (0.80-0.85) to avoid OOM when the OS needs memory.
|
|
- Only 8 GiB swap. Set `--swap-space` conservatively (4-8 GiB).
|
|
- ROCm 7.2.4 from AMD repos. vLLM ROCm support requires ROCm 6.3+.
|
|
- Python 3.14.4 is very new. vLLM ROCm wheels target Python 3.12. Use a Python 3.12 venv.
|
|
- Radeon 8060S falls under Ryzen AI MAX series (gfx1151). vLLM lists this as supported.
|
|
- 1.4 TB free disk space is ample for model storage.
|
|
- `libmpi_cxx.so.40` is missing from the system. Install `openmpi-bin` or provide a workaround for torch MPI dependency.
|
|
|
|
## See Also
|
|
|
|
- [[VLLM Overview]]
|
|
- [[Shared Memory Architecture Dankclaw]]
|
|
- [[RAM CPU Offloading in VLLM]]
|
|
- [[Running Qwen3.6 27B FP8 on Dankclaw]]
|