chore: fix typo in dankclaw specs, format index table
This commit is contained in:
1 parent
dc356acce7
commit
5076ef828f
3 files changed
+2
-28
No files matched your search
@@ -3,7 +3,7 @@
|
|||||||
## Server Overview
|
## Server Overview
|
||||||
|
|
||||||
Dankclaw is an AMD APU server for vLLM inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same 61 GB RAM pool.
|
Dankclaw is an AMD APU server for vLLM inference. The host runs Ubuntu 26.04 with an AMD Ryzen AI MAX+ 395 Strix Halo APU. The APU uses unified memory — CPU and GPU share the same 61 GB RAM pool.
|
||||||
|
rr
|
||||||
## Hardware Specifications
|
## Hardware Specifications
|
||||||
|
|
||||||
### CPU
|
### CPU
|
||||||
|
|||||||
@@ -1,26 +0,0 @@
|
|||||||
# vLLM Scripts — Knowledge Base
|
|
||||||
|
|
||||||
Documentation for running vLLM inference on two local machines.
|
|
||||||
|
|
||||||
## Servers
|
|
||||||
|
|
||||||
| Server | GPU | VRAM / Memory | OS |
|
|
||||||
|--------|-----|---------------|------|
|
|
||||||
| [[Dankserver System Specs\|Dankserver]] | NVIDIA RTX 3090 | 24 GB VRAM, 62 GB RAM | Ubuntu 24.04 |
|
|
||||||
| [[Dankclaw System Specs\|Dankclaw]] | AMD Radeon 8060S (Strix Halo) | 61 GB unified | Ubuntu 26.04 |
|
|
||||||
|
|
||||||
## vLLM Reference
|
|
||||||
|
|
||||||
- [[VLLM Overview]] — installation, CLI, API, architecture, quantization, parallelism
|
|
||||||
- [[VLLM Index]] — quick reference with commands, endpoints, and parameter table
|
|
||||||
|
|
||||||
## Memory Management
|
|
||||||
|
|
||||||
- [[RAM CPU Offloading in VLLM]] — KV cache swap between GPU VRAM and system RAM
|
|
||||||
- [[Hybrid CPU GPU Processing Dankserver]] — NVIDIA GPU compute with system RAM offload
|
|
||||||
- [[Shared Memory Architecture Dankclaw]] — AMD unified memory and ROCm configuration
|
|
||||||
|
|
||||||
## Model Deployment
|
|
||||||
|
|
||||||
- [[Running Qwen3.6 35B A3B FP8 on Dankserver]] — MoE model (35B total, 3B active) on RTX 3090
|
|
||||||
- [[Running Qwen3.6 27B FP8 on Dankclaw]] — Dense model (27B) on Strix Halo APU
|
|
||||||
+1
-1
@@ -5,7 +5,7 @@ Documentation for running vLLM inference on two local machines.
|
|||||||
## Servers
|
## Servers
|
||||||
|
|
||||||
| Server | GPU | VRAM / Memory | OS |
|
| Server | GPU | VRAM / Memory | OS |
|
||||||
|--------|-----|---------------|------|
|
| --------------------------------------- | ----------------------------- | --------------------- | ------------ |
|
||||||
| [[Dankserver System Specs\|Dankserver]] | NVIDIA RTX 3090 | 24 GB VRAM, 62 GB RAM | Ubuntu 24.04 |
|
| [[Dankserver System Specs\|Dankserver]] | NVIDIA RTX 3090 | 24 GB VRAM, 62 GB RAM | Ubuntu 24.04 |
|
||||||
| [[Dankclaw System Specs\|Dankclaw]] | AMD Radeon 8060S (Strix Halo) | 61 GB unified | Ubuntu 26.04 |
|
| [[Dankclaw System Specs\|Dankclaw]] | AMD Radeon 8060S (Strix Halo) | 61 GB unified | Ubuntu 26.04 |
|
||||||
|
|
||||||
|
|||||||
Reference in new issue
Block a user