docs: polish pass — fix stale names, duplicates, branding, and README
- Normalize 'VLLM' to 'vLLM' in prose across 6 docs (32 occurrences; wikilink targets untouched) - Remove duplicated Environment Variables block in 27B Dankclaw doc - Update stale model refs Qwen3-30B-A3B -> Qwen3.6-35B-A3B in example commands - Fix VLLM Index: -- separators to em-dashes; correct model names on links - README: document active services (ROCmFPX llama-server on Dankclaw, vLLM AWQ on Dankserver), replace broken [[docs/README.md]] link with docs/index.md
This commit is contained in:
1 parent
993b6af576
commit
f650fff0aa
8 files changed
+62
-58
No files matched your search
@@ -13,12 +13,12 @@ In unified memory:
|
||||
1. CPU and GPU share one physical memory pool
|
||||
2. The OS and GPU driver manage memory allocation
|
||||
3. There is no separate VRAM or system RAM
|
||||
4. The total available memory appears as GPU memory to VLLM
|
||||
4. The total available memory appears as GPU memory to vLLM
|
||||
5. Memory pages move between CPU and GPU transparently
|
||||
|
||||
### Implications for VLLM
|
||||
### Implications for vLLM
|
||||
|
||||
- VLLM sees the full memory as GPU memory
|
||||
- vLLM sees the full memory as GPU memory
|
||||
- No explicit swap_space parameter needed for memory extension
|
||||
- The GPU driver handles memory paging automatically
|
||||
- Performance depends on memory bandwidth and latency
|
||||
@@ -206,7 +206,7 @@ For FP4 on Dankclaw, the ROCmFPX llama.cpp fork (`Q2_0_ROCMFP4`) provides native
|
||||
### Basic APU Deployment
|
||||
|
||||
```
|
||||
vllm serve Qwen/Qwen3-30B-A3B \
|
||||
vllm serve Qwen/Qwen3.6-35B-A3B \
|
||||
--attention-backend ROCM_AITER_UNIFIED_ATTN \
|
||||
--gpu-memory-utilization 0.85 \
|
||||
--swap-space 8 \
|
||||
@@ -217,7 +217,7 @@ vllm serve Qwen/Qwen3-30B-A3B \
|
||||
### With FP8 Model
|
||||
|
||||
```
|
||||
vllm serve Qwen/Qwen3-30B-A3B-FP8 \
|
||||
vllm serve Qwen/Qwen3.6-35B-A3B-FP8 \
|
||||
--attention-backend ROCM_AITER_UNIFIED_ATTN \
|
||||
--gpu-memory-utilization 0.85 \
|
||||
--kv-cache-dtype fp8 \
|
||||
@@ -227,7 +227,7 @@ vllm serve Qwen/Qwen3-30B-A3B-FP8 \
|
||||
### With Long Context
|
||||
|
||||
```
|
||||
vllm serve Qwen/Qwen3-30B-A3B \
|
||||
vllm serve Qwen/Qwen3.6-35B-A3B \
|
||||
--attention-backend ROCM_AITER_UNIFIED_ATTN \
|
||||
--gpu-memory-utilization 0.8 \
|
||||
--swap-space 16 \
|
||||
|
||||
Reference in new issue
Block a user