serverAppConfigs/serverAppConfigs-docs/LLM/index.md

LLM fleet — index

The three live endpoint pages are the only pages that carry a shape. Everything else here is a technique or a piece of hardware, and each of those owns exactly that one thing. There is no worklog and no era page: a payload swap is one row in the endpoint's Eras table, and the numbers a retired era measured are gone.

Live endpoints

Page	Owns
frank-archon	The radiance endpoint: live shape and harness contract, every era with its rollback path, and the laws it taught.
frank-dragoon	The iGPU endpoint: live shape, every era with its rollback path, the laws it paid for, and the files that own it.
frank-zealot	The RTX 3090 endpoint: live shape exactly as the env ships it, every era with its rollback path, and its card laws.

Radiance engine reference

Page	Owns
Radiance Engine	The radiance inference engine: its shape, plugin model, container format, and how the reference pages fit together.
Radiance Serve Options	Every radiance serve flag grouped by task, with its default and the law that decides when to move it.
Radiance HTTP API	The HTTP surface radiance serves: endpoints, request fields, streaming, tools, and refusal rules.
Radiance Conversion	Turning a checkpoint into a .rad container: rad-convert, the recipe language, quantisers, reuse and export.
Radiance Model Families	Which radiance plugin claims which model family, and the conversion command and recipe of record for each.
Radiance Plugins	Writing radiance kernel and quantiser plugins: the ABI, kernel rows, hooks, encodings, and the build path.
Radiance Architecture Plugins	Writing a radiance architecture plugin: declaring weights, buffers, KV groups and ops, then issuing the step.
Radiance Tools	The radiance inspection, measurement and tokeniser tools, with the flags and verdicts each one reports.
Radiance Operations	Running a radiance server: the container contract, host prerequisites, readiness, ledgers and safe restarts.

Retired endpoints

Page	Owns

Pipeline Parallelism (series)

Page	Owns

Techniques, hardware, trials

Page	Owns
Dankclaw Improvements	This page collects concrete, sourced recommendations to improve Dankclaw
Dankclaw System Specs	Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference.
dankclaw-iommu-translation-off	Why Dankclaw boots with identity DMA, what the earlier off-era bought and cost, and which tooling owns the boot line.
Dankserver System Specs	Dankserver hardware and OS state since the board swap: board, lane topology, cards, memory, kernel posture.
DFlash DSpark Speculative Decoding	DFlash and DSpark are the two newest speculative decoding methods.
GGUF Compatibility	Answering whether an engine loads a GGUF from the file header alone, and pinning a fork build that can.
Heterogeneous Split Triage	Triage before splitting across unequal accelerators: link characterisation, real bottleneck, what placement never buys.
Llama Cpp Serving Sizing	Measurement-first sizing for llama.cpp shapes: slot pools against a headroom band, per-device accounting, prompt cache.
LLM Performance Diagnosis	Probing why a served model is slow: the flat-depth probe, offload duty-cycle arithmetic, and step-shape attribution.
Model Swap and Rollback	The model-swap discipline: fit preflight, fetch verification, build and flag checks, live validation, three-pin revert.
PCIe Link and Atomics	Link probing, the streaming-versus-compute ceiling arithmetic, and the atomics wall that decides multi-GPU collectives.
Quantization by Hardware Architecture	This page maps LLM quantization formats to the GPU and CPU architectures that support them.
Quantization Production	Making a quantized payload here: the conversion recipe, the scoring gate, and the campaign ladder behind a shipped file.
RDNA4 MoE Expert Offload VRAM Budget	Expert-offload arithmetic on the RDNA4 fork: movable terms, the utilisation law, graph charge, ceilings, context ladder.
Shared Memory Architecture Dankclaw	Dankclaw uses AMD Strix Halo APU with unified memory architecture.

Pages

Page	Owns