diff --git a/docs/LLM/index.md b/docs/LLM/index.md index 9aafb97..64537ca 100644 --- a/docs/LLM/index.md +++ b/docs/LLM/index.md @@ -53,8 +53,9 @@ MTP draft + Turbo4 V cache, 262K ctx / 1 slot] (bs1/bs3/bs4/bs6, 8k–700k KV) on Dankserver RTX 3090 - [[deployment]] — deploy and update process for both servers - [[frank-redo-2026-08-17]] — the 2026-08-17 topology change -- [kingjones Qwen3.8 Uncensored ROCmFP4 STRIX MTP](https://huggingface.co/kingjones777/Qwen3.8-27B-Uncensored-ROCmFP4-STRIX-MTP-GGUF) — active frank-default-large model on Dankclaw; Q6 AGENT main model with standalone MTP -- [[kingjones-strix-mtp]] — the active Q6 AGENT runbook: serving profile, standalone MTP, reasoning + preserve_thinking, 114 GiB TTM/GTT +- [[kingjones-strix-rocmfp4]] — active frank-default-large runbook: + kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX-GGUF, 177B params + (56B MoE + 51.2B PLE), single 113.47 GiB GGUF, STRIX tier - [[ubatch-benchmark-large]] — active-model llama-bench ubatch sweep plan and results - [[kingjones-q8agent-rocmfpx]] — the retired Q8_0-AGENT investigation and `set_rows` failure - [[eemin-rocmi4-mtp]] — the former caf-eemin Qwen3.8-27B embedded-MTP model @@ -64,8 +65,8 @@ MTP draft + Turbo4 V cache, 262K ctx / 1 slot] - [[ikllama-ornith-dankserver]] — the retired ik_llama.cpp runtime for frank-default-small (2026-08-26): q8_0 + Hadamard KV cache, split-mode none (single-GPU), mandatory FA_ALL_QUANTS build flags -- [[kingjones-strix-mtp]] — the active kingjones Qwen3.8-27B ROCmFP4 STRIX MTP - model on Dankclaw (restored 2026-09-01 after the Q8_0 AGENT experiment) +- [[kingjones-strix-mtp]] — the former Q6 AGENT runbook (restored 2026-09-01 + after Q8_0 failure, then superseded by the STRIX deployment on 2026-08-27) - [[ciru-activefpx-promptforge]] — the RETIRED v3 CIRU PromptForge runtime on Dankclaw (superseded 2026-08-24 by the kingjones ROCmFP4 model) - [[kairic-edge]] — the retired Kairic Edge IU4 experiment