Frank
02883d3ed2
Copy of the legacy ~/.pi/agent/docs tree rebuilt as the command-center knowledge base: concept files promoted to path identity, index listings stripped of frontmatter, all wikilinks/relative links resolved, every checkable claim verified against the live fleet (Dankserver = Ryzen 7 7700X + RTX 3090; Strix Halo is Dankclaw), unverifiable claims tagged. kb-lint exits 0.
1.3 KiB
1.3 KiB
Ornith llama.cpp Setup
Complete reference for running Ornith-9B/35B MoE models with llama.cpp server on dankware.
Concept Files
| File | Type | Description |
|---|---|---|
| api-endpoints.md | reference | Complete reference for health check, model listing, chat completions, and nat... |
| gpu-offloading.md | reference | How many GPU layers to offload based on your VRAM size for both Ornith 9B and... |
| installation.md | howto | Step-by-step setup — clone and build llama.cpp, download models, start the se... |
| model-specs.md | reference | Specifications for Ornith-1.0-9B dense and Ornith-1.0-35B MoE models — contex... |
| performance.md | reference | Token throughput benchmarks for Ornith 9B and 35B models with GPU vs CPU infe... |
| pi-configuration.md | howto | How to add Ornith models to models.json so pi can use the local llama.cpp ser... |
| systemd-service.md | howto | Set up llama.cpp server as a background service with systemd for persistent o... |
| troubleshooting.md | howto | Common errors — CUDA OOM, segfaults, model not responding, poor performance —... |