diff --git a/README.md b/README.md index b78cd8e..32b8ebd 100644 --- a/README.md +++ b/README.md @@ -14,7 +14,7 @@ Scripts for running LLM inference on two local machines. | Service | Host | Runtime | Model | Port | |---------|------|---------|-------|------| | frank-default-large | dankclaw | vLLM-ROCm (CIRU) | Ling-3.0-flash CIRU INT4 MTP | 7770 | -| frank-default-small | dankserver | llama.cpp (DFlash) | Qwen3.6-35B-A3B uncensored Q6_K_P | 7770 | +| frank-default-small | dankserver | llama.cpp (ngram-mod) | Qwen3.6-35B-A3B uncensored Q6_K_P | 7770 | > The retired ROCmFPX llama.cpp service on Dankclaw was replaced by the vLLM service above. The retired `vllm-awq-qwen36` (AWQ 4-bit) service on Dankserver was replaced by the llama.cpp service above. Legacy unit files remain in `scripts/` for reference. @@ -23,7 +23,7 @@ Scripts for running LLM inference on two local machines. | Model | Target | Format | |-------|--------|--------| | Ling-3.0-flash CIRU INT4 (MTP) | dankclaw | INT4 W4A16 (Quark/vLLM) | -| Qwen3.6 35B A3B uncensored Q6_K_P (DFlash draft) | dankserver | GGUF Q6_K_P (llama.cpp, MoE offload) | +| Qwen3.6 35B A3B uncensored Q6_K_P (ngram-mod speculative decoding) | dankserver | GGUF Q6_K_P (llama.cpp, MoE offload) | | Qwen3.6 35B A3B AWQ 4bit | dankserver | AWQ (retired) | | Qwen3.6 35B A3B FP8 | dankserver | FP8 (documented, not active) | | Qwen3.6 27B FP8 | dankclaw | FP8 (documented, not active) |