Dankserver System Specs
Server Overview
Dankserver is an NVIDIA GPU server for vLLM inference. The host runs Ubuntu 26.04 (Resolute Raccoon) with an RTX 3090 and 62 GB of system RAM.
Hardware Specifications
CPU
| Property |
Value |
| Architecture |
x86_64 |
| Vendor |
AuthenticAMD |
| Model |
AMD Ryzen 7 7700X |
| Cores |
8 (1 socket) |
| NUMA Nodes |
1 (node 0, 63503 MB) |
GPU
| Property |
Value |
| Model |
NVIDIA GeForce RTX 3090 |
| VRAM |
24576 MiB (24 GB) |
| Driver |
595.84 |
| CUDA Version |
13.2 |
| CUDA Toolkit |
12.0 (nvcc) |
Memory
| Property |
Value |
| System RAM |
62 GiB |
| Swap |
127 GiB |
| /dev/shm |
32 GiB |
Storage
| Filesystem |
Size |
Used |
Avail |
Use% |
| / (nvme0n1p2) |
915G |
729G |
140G |
84% |
| /mnt/entropy (dm-0) |
91T |
86T |
910G |
99% |
Network
| Interface |
Type |
Speed |
IP |
Notes |
| eno1 |
onboard |
2500 Mb/s (2.5 GbE) |
192.168.0.235 (DHCP) |
RPC worker endpoint (port 50052). Default route via 192.168.0.1. |
| enxe8ea6ab7ebca |
USB-C class adapter |
2500 Mb/s |
192.168.0.252 |
UNPLUGGED 2026-08-17. Was idle (unused by the RPC path). |
| wlp8s0 |
WiFi |
- |
- |
Unused (carrier down). |
| docker0 |
bridge |
- |
172.17.0.1 |
Down; internal docker traffic only. |
OS and Software
| Property |
Value |
| OS |
Ubuntu 26.04 LTS (Resolute Raccoon) |
| Kernel |
7.0.0-30-generic |
| Python |
3.14.4 |
Active Services
The active service on Dankserver is frank-default-small.service: the llama.cpp Ornith-1.5-35B-A3B CRACK (Q6_K) on port 7770, with expert tensors selected by --override-tensor; every full-attention block plus blocks 35–40 remain on CUDA. The earlier PP worker (frank-pp-worker.service) was retired with the 2026-08-17 redo. See deployment.
Hardware Relevance
- 24 GB VRAM hosts the Q6_K non-expert tensors and the full-attention/final-layer expert placement. The context pool contains 491520 f16 cells across three 163840-token slots. The service uses ngram-mod only and
ubatch=1024. Verify actual headroom after each model restart with nvidia-smi and the service journal.
- 62 GB system RAM holds the remaining CPU-resident expert tensors with room to spare.
- 127 GB swap is available for CPU KV cache paging if GPU KV offload is disabled.
- Root disk has approximately 140 GB free. Store the GGUF models under
/home/dank/models (about 32 GB total).
See Also
