vLLM Scripts

Scripts for running large language models via vLLM on two local machines.

Targets

Host User Codename Architecture
dankserver dank DankServer NVIDIA GPU + System RAM
dankclaw dank DankClaw AMD Strix Halo (Shared Memory)

Models

Model Target Format
Qwen3.6 35B A3B FP8 dankserver FP8
Qwen3.6 27B FP8 dankclaw FP8

Structure

  • docs/ — Project knowledge base with research notes on vLLM configuration, hardware specifics, and deployment notes
  • scripts/ — Executable vLLM launch scripts (coming soon)

Knowledge Base

See docs/README.md for the project knowledge base index.

S
Description
Podman deployment configs for Dankserver and Dankclaw
Readme
8.3 MiB
Languages
Shell 60.4%
Python 21%
HTML 6.2%
Jinja 3.9%
C++ 3.9%
Other 4.6%