From 0aabd57c69daf9fee8d03d0eb2ff37bdc40124ec Mon Sep 17 00:00:00 2001 From: Frank Date: Tue, 11 Aug 2026 02:42:32 -0700 Subject: [PATCH] =?UTF-8?q?docs:=20README=20=E2=80=94=20frank-default-smal?= =?UTF-8?q?l=20runtime=20=E2=86=92=20ngram-mod=20(DFlash=20retired)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index b78cd8e..32b8ebd 100644 --- a/README.md +++ b/README.md @@ -14,7 +14,7 @@ Scripts for running LLM inference on two local machines. | Service | Host | Runtime | Model | Port | |---------|------|---------|-------|------| | frank-default-large | dankclaw | vLLM-ROCm (CIRU) | Ling-3.0-flash CIRU INT4 MTP | 7770 | -| frank-default-small | dankserver | llama.cpp (DFlash) | Qwen3.6-35B-A3B uncensored Q6_K_P | 7770 | +| frank-default-small | dankserver | llama.cpp (ngram-mod) | Qwen3.6-35B-A3B uncensored Q6_K_P | 7770 | > The retired ROCmFPX llama.cpp service on Dankclaw was replaced by the vLLM service above. The retired `vllm-awq-qwen36` (AWQ 4-bit) service on Dankserver was replaced by the llama.cpp service above. Legacy unit files remain in `scripts/` for reference. @@ -23,7 +23,7 @@ Scripts for running LLM inference on two local machines. | Model | Target | Format | |-------|--------|--------| | Ling-3.0-flash CIRU INT4 (MTP) | dankclaw | INT4 W4A16 (Quark/vLLM) | -| Qwen3.6 35B A3B uncensored Q6_K_P (DFlash draft) | dankserver | GGUF Q6_K_P (llama.cpp, MoE offload) | +| Qwen3.6 35B A3B uncensored Q6_K_P (ngram-mod speculative decoding) | dankserver | GGUF Q6_K_P (llama.cpp, MoE offload) | | Qwen3.6 35B A3B AWQ 4bit | dankserver | AWQ (retired) | | Qwen3.6 35B A3B FP8 | dankserver | FP8 (documented, not active) | | Qwen3.6 27B FP8 | dankclaw | FP8 (documented, not active) |