frank-small docs: runbook renamed + rewritten for the RCO-IQ3_XXS MTP-on shape (489 MiB free, 63.3 t/s recipe, draft ctx ~2.4 GiB measured); AGENTS, vault indexes, models.yml comment, MiMo cross-link retargeted
This commit is contained in:
@@ -369,14 +369,14 @@ The LLM inference fleet on the two hosts. Full index:
|
||||
- [[ciru-activefpx-promptforge]] — the RETIRED v3 CIRU PromptForge runtime on Dankclaw (superseded 2026-08-24)
|
||||
- [[kingjones-strix-mtp]] — the kingjones Qwen3.8-27B ROCmFP4 STRIX MTP model on Dankclaw (active)
|
||||
- [[dealign-ornith-crack]] — the retired Ornith-1.5-35B-A3B CRACK model on Dankserver (retired 2026-09-02)
|
||||
- [[frank-small-llama-swift15-iq3s-mtp-131072]] — the ACTIVE frank-small
|
||||
runbook since 2026-10-05 (evening; **2 × 131,072 no-spec since
|
||||
2026-10-06**): llama.cpp master (CUDA sm_86) serving ukisai's
|
||||
Swift-1.5-Qwen3.8-27B GSQ-RCO IQ3_S (the -mtp file's head present but NOT
|
||||
drafted — speculation off) on the RTX 3090 — TWO 131,072-token
|
||||
conversations at Frank's 128k cap, the tight fit he ordered (1,397 MiB
|
||||
measured free), q8_0 K + q8_0 V, vision through the base-model
|
||||
projector, ~48 t/s without the drafter
|
||||
- [[frank-small-llama-swift15-unc-iq3xxs-mtp-131072]] — the ACTIVE
|
||||
frank-small runbook since 2026-10-05 (evening; **UNCECERSED RCO-IQ3_XXS
|
||||
with MTP back on since 2026-10-06 evening**): llama.cpp master (CUDA
|
||||
sm_86) serving ajgazin's Swift-1.5-Qwen3.8-27B Uncensored RCO-IQ3_XXS
|
||||
(the MTP head in the file is drafted) on the RTX 3090 — TWO
|
||||
131,072-token conversations at Frank's 128k cap, the tightest fit in
|
||||
the endpoint's history (489 MiB measured free), q8_0 K + q8_0 V, vision
|
||||
through the publisher's own projector, ~63 t/s recipe decode with MTP
|
||||
- [[frank-small-llama-mimo-q6k-2x200704]] — RETIRED 2026-10-05 (evening,
|
||||
superseded by swift15): llama.cpp master serving
|
||||
bartowski/MiMo-V2.6-Distill-Qwen-9B-GGUF **Q6_K** — TWO conversations at
|
||||
|
||||
Reference in New Issue
Block a user