Dankserver System Specs
Server Overview
Dankserver is an NVIDIA GPU server for vLLM inference. The host runs Ubuntu 26.04 (Resolute Raccoon) with an RTX 3090 and 62 GB of system RAM.
Hardware Specifications
CPU
| Property |
Value |
| Architecture |
x86_64 |
| Vendor |
AuthenticAMD |
| Model |
AMD Ryzen 7 7700X |
| Cores |
8 (1 socket) |
| NUMA Nodes |
1 (node 0, 63503 MB) |
GPU
| Property |
Value |
| Model |
NVIDIA GeForce RTX 3090 |
| VRAM |
24576 MiB (24 GB) |
| Driver |
595.84 |
| CUDA Version |
13.2 |
| CUDA Toolkit |
12.0 (nvcc) |
Memory
| Property |
Value |
| System RAM |
62 GiB |
| Swap |
127 GiB |
| /dev/shm |
32 GiB |
Storage
| Filesystem |
Size |
Used |
Avail |
Use% |
| / (nvme0n1p2) |
915G |
729G |
140G |
84% |
| /mnt/entropy (dm-0) |
91T |
86T |
910G |
99% |
Network
| Interface |
Type |
Speed |
IP |
Notes |
| eno1 |
onboard |
2500 Mb/s (2.5 GbE) |
192.168.0.235 (DHCP) |
RPC worker endpoint (port 50052). Default route via 192.168.0.1. |
| enxe8ea6ab7ebca |
USB-C class adapter |
2500 Mb/s |
192.168.0.252 |
UNPLUGGED 2026-08-17. Was idle (unused by the RPC path). |
| wlp8s0 |
WiFi |
- |
- |
Unused (carrier down). |
| docker0 |
bridge |
- |
172.17.0.1 |
Down; internal docker traffic only. |
OS and Software
| Property |
Value |
| OS |
Ubuntu 26.04 LTS (Resolute Raccoon) |
| Kernel |
7.0.0-30-generic |
| Python |
3.14.4 |
Active Services
The active service on Dankserver is frank-default-small.service: the llama.cpp Ornith-1.5-35B-A3B CRACK (Q6_K) on port 7770, with expert tensors from blocks 0 through 36 held on CPU via --override-tensor. The earlier PP worker (frank-pp-worker.service) was retired with the 2026-08-17 redo. See deployment.
Hardware Relevance
- 24 GB VRAM hosts the Q6_K non-expert tensors and expert tensors from blocks 37 through 40. The new context pool contains 589824 f16 cells across three 196608-token slots. The configuration targets about 1.5 to 2 GiB of free VRAM for checkpoint overhead. Verify the actual headroom after each model restart with
nvidia-smi and the service journal.
- 62 GB system RAM holds the ~22.76 GiB of CPU expert tensors with room to spare.
- 127 GB swap is available for CPU KV cache paging if GPU KV offload is disabled.
- Root disk has approximately 140 GB free. Store the GGUF models under
/home/dank/models (about 32 GB total).
See Also
