357 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Frank	2bb1b2ae1d	Baseline: ThinkingCap 27B FP8 on dankclaw with enforce-eager and validation timeout	2026-08-07 08:58:20 -07:00
Frank	e4fba35e89	Baseline: ThinkingCap 27B FP8 on dankclaw ... - vLLM 0.26.0+rocm723 - --kv-cache-dtype fp8 --gpu-memory-utilization 0.80 - --max-model-len 32768 --max-num-batched-tokens 2048 - --max-num-seqs 32 --reasoning-parser qwen3 --language-model-only - Baseline response time: 219s for 50 tokens	2026-08-07 08:49:59 -07:00
Frank	7dce375ab4	docs: fix dankclaw specs (30GiB RAM, 96GiB GPU-visible, ROCm 7.2.4) + add validate.sh	2026-08-06 22:40:44 -07:00
Frank	5076ef828f	chore: fix typo in dankclaw specs, format index table	2026-08-06 22:29:23 -07:00
Frank	dc356acce7	docs: add top-level knowledge base index	2026-08-06 00:16:47 -07:00
Frank	671129ea69	chore: ignore obsidian workspace files	2026-08-06 00:14:06 -07:00
Frank	39db415348	feat: initialize vLLM scripts knowledge base ... - VLLM Overview: installation, CLI, API, architecture, quantization, parallelism - VLLM Index: quick reference with commands, endpoints, parameters - Dankserver System Specs: RTX 3090 24GB, 62GB RAM, Ubuntu 24.04 - Dankclaw System Specs: AMD Strix Halo APU, 61GB unified, ROCm 7.1 - RAM/CPU Offloading in VLLM: KV cache swap, gpu_memory_utilization, preemption - Hybrid CPU/GPU Processing (Dankserver): NVIDIA GPU + system RAM configuration - Shared Memory Architecture (Dankclaw): AMD unified memory and ROCm setup - Running Qwen3.6 35B A3B FP8 on Dankserver: MoE model deployment guide - Running Qwen3.6 27B FP8 on Dankclaw: dense model deployment guide	2026-08-05 23:49:02 -07:00