Files
command-center/omp-docs/tools/ornith-llama-cpp-setup/api-endpoints.md
T
Frank 02883d3ed2 docs: rebuild KB in OKF v0.1 with live-verified facts
Copy of the legacy ~/.pi/agent/docs tree rebuilt as the command-center
knowledge base: concept files promoted to path identity, index listings
stripped of frontmatter, all wikilinks/relative links resolved, every
checkable claim verified against the live fleet (Dankserver = Ryzen 7
7700X + RTX 3090; Strix Halo is Dankclaw), unverifiable claims tagged.
kb-lint exits 0.
2026-08-28 07:57:13 -07:00

1.5 KiB

type, title, description, tags, timestamp, verified
type title description tags timestamp verified
reference llama.cpp Server API Endpoints Complete reference for health check, model listing, chat completions, and native completion endpoints.
unverified
ornith
api
llama.cpp
endpoints
2026-07-18 2026-08-28

API Endpoints

The llama.cpp server provides these endpoints:

Health Check

curl http://localhost:8080/health

List Models

curl http://localhost:8080/v1/models

Chat Completions (OpenAI-compatible)

curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "frank-default-local",
    "messages": [...],
    "max_tokens": 100
  }'

Native Completion Endpoint

curl http://localhost:8080/completion \
  -H "Content-Type: application/json" \
  -d '{
    "prompt": "Hello, how are you?",
    "n_predict": 100
  }'

Model Features

Reasoning/Thinking Blocks

Ornith models use <think>...</think> blocks for reasoning. The server automatically:

  • Detects and preserves reasoning content
  • Returns reasoning in reasoning_content field
  • Supports the developer role (or falls back to system)

Chat Template

The model uses a specific chat template that supports:

  • System prompts
  • User/Assistant roles
  • Reasoning preservation