docs(LLM): Quantization Production reference — per-card self-quant playbooks, REAP/Heretic/abliteration/K_P prior art
This commit is contained in:
1 parent
184a5c665a
commit
6b677139ad
3 files changed
+165
-1
No files matched your search
@@ -492,6 +492,9 @@ frank-secondary, port 7771]
|
||||
One polished reference page per skill-cluster, distilled from the managed
|
||||
skill library into the vault (see [log](../log.md) for the wave plan):
|
||||
|
||||
- [[Quantization Production]] — how we self-make quants per card
|
||||
(imatrix/K_P ladders, radiance recipes, REAP/Heretic/abliteration
|
||||
prior art), and what each runtime decodes natively
|
||||
- [[GGUF Compatibility]] — what a GGUF's tensor histogram and header demand
|
||||
of a loader; how the runtime is chosen by the file
|
||||
- [[Llama Cpp Serving Sizing]] — slot/pool/KV sizing laws, boot-shape
|
||||
|
||||
Reference in new issue
Block a user