docs: NPU endpoint now serves qwythos:9b (2026-08-17 swap, FLM 1.0.1)

- AGENTS.md + deployment.md target maps: qwen3.6-moe:35b-a3b -> qwythos:9b
- FLM doc: FLM 1.0.1 upgrade record, flm-add install state, model swap
  paragraph (commit c85ff6c), FLM_CONFIG_PATH/FLM_XCLBIN_PATH requirement
- pi client entry note: id qwythos:9b, text-only input, developer-role compat kept
This commit is contained in:
Frank committed 2026-08-17 01:24:43 -07:00
1 parent aa1941d592
commit e9ec5cd13f
3 files changed
+9 -5

No files matched your search

+4 -3
View File
@@ -10,8 +10,9 @@ UD-Q8_K_XL): MTP draft (bundled head, `--spec-draft-n-max 4`) over the
3090 `ggml-rpc` worker, head GPU side on ROCm0 (no `--device` flag), port
7770.
The Dankclaw NPU endpoint (FastFlowLM, `frank-default-small`, port 52625)
serves Qwen3.6-35B-A3B as registry tag `qwen3.6-moe:35b-a3b` at 262144 ctx
(swapped in 2026-08-16; the old llama.cpp 35B service on Dankserver is
serves Qwythos-9B-Claude-Mythos-5-1M (abliterated) as registry tag
`qwythos:9b` at 262144 ctx (swapped in 2026-08-17; previously
`qwen3.6-moe:35b-a3b`; the old llama.cpp 35B service on Dankserver is
stopped). See [docs/deployment.md](docs/deployment.md) for the deployment
process, [docs/qwen3.8-spec-matrix.md](docs/qwen3.8-spec-matrix.md) for the
spec history and current production state, and
@@ -81,7 +82,7 @@ Target map:
| Target | Host | Runtime | Service | Port |
|--------|------|---------|---------|------|
| Dankclaw | dank@dankclaw | llama.cpp PP head (Qwen3.8-27B UD-Q8_K_XL, split 0.40/0.60 to the Dankserver worker via RPC, MTP+ngram-mod, f16 KV) | frank-default-large | 7770 |
| Dankclaw | dank@dankclaw | FastFlowLM NPU (XDNA2 50 TOPS, qwen3.6-moe:35b-a3b, 262144 ctx; see [[FastFlowLM NPU Inference]]) | frank-default-small | 52625 |
| Dankclaw | dank@dankclaw | FastFlowLM NPU (XDNA2 50 TOPS, qwythos:9b Q4NX 7.76 GB, 262144 ctx; see [[FastFlowLM NPU Inference]]) | frank-default-small | 52625 |
| Dankserver | dank@dankserver | ggml-rpc worker (RTX 3090, receives the head's tensor share) | frank-pp-worker | 50052 |
## Runtime & Troubleshooting