docs: correct Dankclaw RAM figure (64 GiB, 61 GiB visible)
The box was upgraded from 32 GB to 64 GB. Two vLLM sizing pages still stated 30 GiB physical RAM; rocm-smi reports 64 GiB and free shows 61 GiB visible. Update the hardware tables and the ROCm overcommit guidance to match. Also removes the vllm-vulkan backend page, its index links, and the frank-vk-compat plugin from the working tree. The vLLM service on Dankclaw is being retired in favor of the CIRU llama.cpp runtime.
This commit is contained in:
1 parent
044dd49011
commit
4941d911f2
2 files changed
+3
-3
No files matched your search
@@ -142,7 +142,7 @@ Unified memory has lower bandwidth than dedicated VRAM:
|
||||
|
||||
### ROCm Overcommit
|
||||
|
||||
ROCm reports 96 GiB GPU memory on Strix Halo APU. Physical RAM is 30 GiB. The GPU can address more than physical RAM exists. vLLM will see 96 GiB and try to allocate accordingly. Set `--gpu-memory-utilization` to 0.80 or lower to prevent OOM.
|
||||
ROCm reports 96 GiB GPU memory on Strix Halo APU. Physical RAM is 64 GiB (61 GiB visible; corrected 2026-08-17, the box was upgraded from 32 GB). The GPU can address more than physical RAM exists. vLLM will see 96 GiB and try to allocate accordingly. Set `--gpu-memory-utilization` to 0.80 or lower to prevent OOM.
|
||||
|
||||
Lower bandwidth means slower inference. Plan for lower throughput.
|
||||
|
||||
|
||||
Reference in new issue
Block a user