Files

T

Frank e133d2412d Merge origin/main into docs/radiance-prefill-decode-census

Two conflicts, both from the 2026-10-19 vault compaction on main:

* frontmatter description — main shortened it to satisfy OKF DESC
  (max 120 chars); this branch's longer wording would have failed the
  seam. Kept main's shape and folded the new §9 in by naming
  step-shape attribution instead of profiler attribution.
* the Related bullet for [[vLLM Porting and Compile Triage]] — that
  page was destroyed on main, so the link is dropped rather than
  resurrected; this branch's [[frank-archon]] row is kept.

Index rows regenerated with scripts/gen-vault-index.py.

2026-10-19 14:20:05 -07:00

3.0 KiB

Raw Permalink Blame History

LLM fleet — index

The three live endpoint pages are the only pages that carry a shape. Everything else here is a technique or a piece of hardware, and each of those owns exactly that one thing. There is no worklog and no era page: a payload swap is one row in the endpoint's Eras table, and the numbers a retired era measured are gone.

Live endpoints

Page	Owns
frank-archon	The radiance endpoint: live shape and harness contract, every era with its rollback path, and the laws it taught.
frank-dragoon	The iGPU endpoint: live shape, every era with its rollback path, the laws it paid for, and the files that own it.
frank-zealot	The RTX 3090 endpoint: live shape exactly as the env ships it, every era with its rollback path, and its card laws.

Retired endpoints

Page	Owns

Pipeline Parallelism (series)

Page	Owns

Techniques, hardware, trials

Page	Owns
Dankclaw Improvements	This page collects concrete, sourced recommendations to improve Dankclaw
Dankclaw System Specs	Dankclaw is an AMD APU server for CIRU ROCmFPX llama.cpp inference.
dankclaw-iommu-translation-off	Why Dankclaw boots with identity DMA, what the earlier off-era bought and cost, and which tooling owns the boot line.
Dankserver System Specs	Dankserver hardware and OS state since the board swap: board, lane topology, cards, memory, kernel posture.
DFlash DSpark Speculative Decoding	DFlash and DSpark are the two newest speculative decoding methods.
GGUF Compatibility	Answering whether an engine loads a GGUF from the file header alone, and pinning a fork build that can.
Heterogeneous Split Triage	Triage before splitting across unequal accelerators: link characterisation, real bottleneck, what placement never buys.
Llama Cpp Serving Sizing	Measurement-first sizing for llama.cpp shapes: slot pools against a headroom band, per-device accounting, prompt cache.
LLM Performance Diagnosis	Probing why a served model is slow: the flat-depth probe, offload duty-cycle arithmetic, and step-shape attribution.
Model Swap and Rollback	The model-swap discipline: fit preflight, fetch verification, build and flag checks, live validation, three-pin revert.
PCIe Link and Atomics	Link probing, the streaming-versus-compute ceiling arithmetic, and the atomics wall that decides multi-GPU collectives.
Quantization by Hardware Architecture	This page maps LLM quantization formats to the GPU and CPU architectures that support them.
Quantization Production	Making a quantized payload here: the conversion recipe, the scoring gate, and the campaign ladder behind a shipped file.
RDNA4 MoE Expert Offload VRAM Budget	Expert-offload arithmetic on the RDNA4 fork: movable terms, the utilisation law, graph charge, ceilings, context ladder.
Shared Memory Architecture Dankclaw	Dankclaw uses AMD Strix Halo APU with unified memory architecture.

Pages

Page	Owns

3.0 KiB Raw Permalink Blame History