docs: fix dankclaw specs (30GiB RAM, 96GiB GPU-visible, ROCm 7.2.4) + add validate.sh

docs/Running Qwen3.6 27B FP8 on Dankclaw.md

@@ -26,10 +26,11 @@ Qwen3.6-27B is a dense vision-language model from the Qwen3.6 series. It uses 27
 |----------|-------|
 | CPU | AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (Strix Halo) |
 | GPU | Integrated Radeon 8060S (unified memory) |
-| Unified RAM | 61 GB (shared CPU + GPU) |
-| Swap | 8 GB |
-| ROCm/HIP | 7.1 |
-| Python | 3.14.4 |
+| Physical RAM | 30 GiB (shared CPU + GPU) |
+| GPU-Visible (ROCm) | 96 GiB (overcommitted) |
+| Swap | 8 GiB |
+| ROCm | 7.2.4 |
+| Python | 3.12.13 (vLLM venv) |
 
 ## Memory Calculation
 
@@ -42,11 +43,11 @@ Qwen3.6-27B is a dense vision-language model from the Qwen3.6 series. It uses 27
 | Overhead | ~2 GB | ~2 GB |
 | **Total (approximate)** | ~58 GB | ~16.5 GB |
 
-The FP8 variant requires approximately 16-17 GB. This fits within the 61 GB unified memory with comfortable headroom for KV cache.
+The FP8 variant requires approximately 16-17 GB. ThinkingCap-FP8 requires ~29 GB. Both fit within the 30 GiB physical RAM, but ROCm reports 96 GiB to vLLM. Set `--gpu-memory-utilization` conservatively (0.80) to avoid OOM.
 
 ## Prerequisites
 
-Install vLLM for ROCm. Version 0.19.0 or later is required for Qwen3.6:
+Install vLLM for ROCm. Version 0.24.0+ is required for Qwen3.6 with speculative decoding:
 
 ```
 uv venv --python 3.12 --seed
@@ -54,13 +55,24 @@ source .venv/bin/activate
 uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/
 ```
 
-Python 3.14.4 is installed on Dankclaw. vLLM ROCm wheels target Python 3.12. Create a virtual environment with Python 3.12 if available. Verify that Python 3.12 is installed:
+Installed: vLLM 0.26.0+rocm723 in Python 3.12.13 venv at `/home/dank/vllm-env`.
+
+### MPI Dependency
+
+Torch requires `libmpi_cxx.so.40`. If missing, install `openmpi-bin`:
 
 ```
-python3.12 --version
+sudo apt install -y openmpi-bin
 ```
 
-If Python 3.12 is not available, install it or use the system Python with `--no-build-isolation`.
+### Environment Variables
+
+Set these for ROCm on Strix Halo:
+
+```
+export HSA_OVERRIDE_GFX_VERSION=11.5.1
+export HF_HOME=/home/dank/.cache/huggingface
+```
 
 ## Environment Variables