docs(LLM): Quantization Production reference — per-card self-quant playbooks, REAP/Heretic/abliteration/K_P prior art

This commit is contained in:
Frank committed 2026-10-08 22:39:18 -07:00
1 parent 184a5c665a
commit 6b677139ad
3 files changed
+165 -1

No files matched your search

+3
View File
@@ -492,6 +492,9 @@ frank-secondary, port 7771]
One polished reference page per skill-cluster, distilled from the managed
skill library into the vault (see [log](../log.md) for the wave plan):
- [[Quantization Production]] — how we self-make quants per card
(imatrix/K_P ladders, radiance recipes, REAP/Heretic/abliteration
prior art), and what each runtime decodes natively
- [[GGUF Compatibility]] — what a GGUF's tensor histogram and header demand
of a loader; how the runtime is chosen by the file
- [[Llama Cpp Serving Sizing]] — slot/pool/KV sizing laws, boot-shape