chore: adopt pre-existing working-tree state before trunk merge
Uncommitted machine/session edits (live config, models, docs drift) were blocking the merge of origin/main. Committed as-is to preserve them; the merge that follows resolves overlapping prose files toward upstream canonical, with local variants recoverable from this commit. Pre-merge copies also in .AGENTTRASH/pre-merge-2026-10-18/.
This commit is contained in:
Frank committed
1 parent
8702f3058d
commit
3713339ffc
14 files changed
+378
-217
No files matched your search
@@ -1,22 +1,24 @@
|
||||
---
|
||||
type: reference
|
||||
title: Dankserver
|
||||
description: Primary llama.cpp inference server at 192.168.0.235:7770, serving frank-default-small with 163,840-token context window.
|
||||
description: Radiance inference server at 192.168.0.235:7770, serving frank-archon (Qwen3.8-Flash-Next iq4r, 2x R9700 TP=2, 200,000-token context).
|
||||
tags:
|
||||
- network
|
||||
- llamacpp
|
||||
- inference
|
||||
- server
|
||||
- unverified
|
||||
generated:
|
||||
by: chief-designer/agent
|
||||
verified: 2026-08-28
|
||||
verified: 2026-10-18
|
||||
status: stable
|
||||
---
|
||||
|
||||
# Dankserver
|
||||
|
||||
Primary llama.cpp inference server for the Frank Program. Serves `frank-default-small` — a fast, capable model with image support.
|
||||
Primary inference server for the Frank Program. Serves `frank-archon`, the
|
||||
main agent model, from a pair of Radeon AI PRO R9700s (tensor-parallel 2).
|
||||
The RTX 3090 that used to live here was removed 2026-09-15 and now runs on
|
||||
Dankclaw.
|
||||
|
||||
## Connection Details
|
||||
|
||||
@@ -28,19 +30,24 @@ Primary llama.cpp inference server for the Frank Program. Serves `frank-default-
|
||||
| **Base URL** | `http://192.168.0.235:7770/v1` |
|
||||
| **API** | OpenAI-compatible completions |
|
||||
| **Authentication** | None |
|
||||
| **Systemd unit** | `frank-archon.service` (root) |
|
||||
|
||||
## Model
|
||||
|
||||
| Property | Value |
|
||||
|----------|-------|
|
||||
| **Model ID** | `frank-default-small` |
|
||||
| **Context Window** | 163,840 tokens |
|
||||
| **Reasoning** | Supported |
|
||||
| **Input Types** | Text, *Image* (unverified) |
|
||||
| **Model ID** | `frank-archon` (display name `frank-archon`) |
|
||||
| **Weights** | Qwen3.8-Flash-Next, radiance iq4r (publisher build) |
|
||||
| **Engine** | radiance, tensor-parallel 2 across both R9700s |
|
||||
| **Context Window** | 200,000 tokens (harness `models.yml`; served pool may differ — see runbook) |
|
||||
|
||||
`frank-medium` (former dual-GPU mid tier) is masked and retired.
|
||||
|
||||
## Usage
|
||||
|
||||
Dankserver serves the small subagent model `frank-default-small`. Small subagent roles route here unless a role override picks a different model.
|
||||
Dankserver carries the main-session model. Subagent role overrides in
|
||||
`agent/models.yml` route here for `task` and `reviewer`; scout/sonic/designer
|
||||
route to Dankclaw.
|
||||
|
||||
```bash
|
||||
# Health check
|
||||
@@ -49,27 +56,34 @@ curl http://192.168.0.235:7770/health
|
||||
# Quick test
|
||||
curl http://192.168.0.235:7770/v1/chat/completions \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"model":"frank-default-small","messages":[{"role":"user","content":"Hello"}],"max_tokens":32}'
|
||||
-d '{"model":"frank-archon","messages":[{"role":"user","content":"Hello"}],"max_tokens":32}'
|
||||
```
|
||||
|
||||
## Hardware
|
||||
## Hardware (verified live 2026-10-18)
|
||||
|
||||
| Property | Value |
|
||||
|----------|-------|
|
||||
| **CPU** | AMD Ryzen 7 7700X (8C/16T, Raphael) |
|
||||
| **GPU** | NVIDIA GeForce RTX 3090 (24 GiB VRAM, EVGA) |
|
||||
| **RAM** | 60 GiB |
|
||||
| **Swap** | 64 GiB (/swapfile) |
|
||||
| **Storage** | Kingston SNV3S1000G NVMe (931.5 GB) + md0 RAID (6×18.2T Toshiba, /mnt/entropy, 91T) |
|
||||
| **OS** | Ubuntu 26.04 LTS, kernel 7.0.0-30-generic |
|
||||
| **NVIDIA Driver** | 595.84 |
|
||||
| **CPU** | AMD Ryzen 7 7700X (8C/16T, Raphael iGPU on board) |
|
||||
| **GPU** | 2× AMD Radeon AI PRO R9700 (Navi 48, 32 GiB each) |
|
||||
| **RAM** | 246 GiB |
|
||||
| **Swap** | effectively none (~0.1 GiB) — the 64 GiB swapfile is on Dankclaw, not here |
|
||||
| **Storage** | 7× 18.2 TB HDD + 1.8 TB NVMe (layout owned by the deploy repo) |
|
||||
| **OS** | Ubuntu 26.04.1 LTS, kernel 7.0.0-38-generic |
|
||||
|
||||
## Related Knowledge Bases (sibling project on the workstation)
|
||||
The old page (verified 2026-08-28) listed an RTX 3090, 60 GiB RAM, and a
|
||||
64 GiB swapfile here; all three were superseded by the 2026-09 hardware swap.
|
||||
|
||||
- **serverAppConfigs** — `/home/dank/Projects/serverAppConfigs/` — Podman deployment config for this host (media and library stack: RomM, Copyparty, Calibre-Web) **plus the LLM inference fleet** (frank-default-small, llama.cpp, :7770). The former `vllmScripts` repo merged into it on 2026-08-22 (history preserved). Start at `/home/dank/Projects/serverAppConfigs/docs/index.md` (see `dankserver/compose.yaml` + `docs/Dankserver/`; LLM fleet at `docs/LLM/index.md`, deploy runbook at `docs/LLM/deployment.md`).
|
||||
## Related Knowledge Bases (sibling project)
|
||||
|
||||
- **serverAppConfigs** — deployment repo + vault, on this workstation at
|
||||
`~/Projects/serverAppConfig/` (docs vault: `~/Projects/serverAppConfig/serverAppConfigs-docs/`).
|
||||
Podman/quadlet deploy config for both servers plus the LLM inference fleet.
|
||||
The live frank-archon runbook (engine flags, KV pool sizing, restart
|
||||
procedures) is `LLM/frank-archon-radiance-qwen38-iq4r.md` in that vault —
|
||||
it, not this page, is the deploy-side source of truth.
|
||||
|
||||
## See Also
|
||||
|
||||
- [[models|models]] — Provider definitions
|
||||
- [[dankclaw|dankclaw]] — Secondary server
|
||||
- [[dankclaw|dankclaw]] — the other inference box (dragoon + zealot)
|
||||
- [[network|network]] — Network topology
|
||||
- [/pi/statusline.md](/pi/statusline.md) — where these models surface in the TUI
|
||||
Reference in new issue
Block a user