Frank
5829a0bfe8
All in-repo path references (AGENTS.md, README, old scripts, report artifacts,
test code paths) rewritten in the same commit; focused-test map extended for
.gitignore, old/scripts/*, dankclaw/comfyui/*, and report/* per this repo's
own convention ('add one before committing'). Obsidian wikilinks are
title-based and unaffected.
77 lines
2.7 KiB
Markdown
77 lines
2.7 KiB
Markdown
# Dankserver System Specs
|
||
|
||
## Server Overview
|
||
|
||
Dankserver is an NVIDIA GPU server for vLLM inference. The host runs Ubuntu 26.04 (Resolute Raccoon) with an RTX 3090 and 62 GB of system RAM.
|
||
|
||
## Hardware Specifications
|
||
|
||
### CPU
|
||
|
||
| Property | Value |
|
||
|----------|-------|
|
||
| Architecture | x86_64 |
|
||
| Vendor | AuthenticAMD |
|
||
| Model | AMD Ryzen 7 7700X |
|
||
| Cores | 8 (1 socket) |
|
||
| NUMA Nodes | 1 (node 0, 63503 MB) |
|
||
|
||
### GPU
|
||
|
||
| Property | Value |
|
||
|----------|-------|
|
||
| Model | NVIDIA GeForce RTX 3090 |
|
||
| VRAM | 24576 MiB (24 GB) |
|
||
| Driver | 595.84 |
|
||
| CUDA Version | 13.2 |
|
||
| CUDA Toolkit | 12.0 (nvcc) |
|
||
|
||
### Memory
|
||
|
||
| Property | Value |
|
||
|----------|-------|
|
||
| System RAM | 62 GiB |
|
||
| Swap | 127 GiB |
|
||
| /dev/shm | 32 GiB |
|
||
|
||
### Storage
|
||
|
||
| Filesystem | Size | Used | Avail | Use% |
|
||
|------------|------|------|-------|------|
|
||
| / (nvme0n1p2) | 915G | 729G | 140G | 84% |
|
||
| /mnt/entropy (dm-0) | 91T | 86T | 910G | 99% |
|
||
|
||
### Network
|
||
|
||
| Interface | Type | Speed | IP | Notes |
|
||
|-----------|------|-------|----|-------|
|
||
| eno1 | onboard | 2500 Mb/s (2.5 GbE) | 192.168.0.235 (DHCP) | RPC worker endpoint (port 50052). Default route via 192.168.0.1. |
|
||
| enxe8ea6ab7ebca | USB-C class adapter | 2500 Mb/s | 192.168.0.252 | UNPLUGGED 2026-08-17. Was idle (unused by the RPC path). |
|
||
| wlp8s0 | WiFi | - | - | Unused (carrier down). |
|
||
| docker0 | bridge | - | 172.17.0.1 | Down; internal docker traffic only. |
|
||
|
||
### OS and Software
|
||
|
||
| Property | Value |
|
||
|----------|-------|
|
||
| OS | Ubuntu 26.04 LTS (Resolute Raccoon) |
|
||
| Kernel | 7.0.0-30-generic |
|
||
| Python | 3.14.4 |
|
||
|
||
### Active Services
|
||
|
||
The active service on Dankserver is `frank-default-small.service`: the llama.cpp Ornith-1.5-35B-A3B CRACK (Q6_K) on port 7770, with expert tensors selected by `--override-tensor`; every full-attention block plus blocks 35–40 remain on CUDA. The earlier PP worker (`frank-pp-worker.service`) was retired with the 2026-08-17 redo. See [[deployment]].
|
||
|
||
## Hardware Relevance
|
||
|
||
- 24 GB VRAM hosts the Q6_K non-expert tensors and the full-attention/final-layer expert placement. The context pool contains 491520 f16 cells across three 163840-token slots. The service uses ngram-mod only and `ubatch=1024`. Verify actual headroom after each model restart with `nvidia-smi` and the service journal.
|
||
- 62 GB system RAM holds the remaining CPU-resident expert tensors with room to spare.
|
||
- 127 GB swap is available for CPU KV cache paging if GPU KV offload is disabled.
|
||
- Root disk has approximately 140 GB free. Store the GGUF models under `/home/dank/models` (about 32 GB total).
|
||
|
||
## See Also
|
||
|
||
- [[VLLM Overview]]
|
||
- [[Hybrid CPU GPU Processing Dankserver]]
|
||
- [[RAM CPU Offloading in VLLM]]
|
||
- [[Running Qwen3.6 35B A3B FP8 on Dankserver]] |