docs: rename frank-default-large/small/sightsound to frank-large/small/npu across vault

Mechanical identity rename across the knowledge base, AGENTS.md, README, the hermes config example, and homepage services.json. No behavior change; served aliases on the LLM endpoints change with the deploy of commit 69f87c8.
2026-09-03 16:17:14 -07:00
1 parent 5a083eee6c
commit 8212d4451a
@@ -1,9 +1,9 @@
 # LLM Fleet — Knowledge Base

 Documentation for the LLM inference fleet on two local machines
-(2026-08-30): FreeToken v0.1.2 on Dankserver (frank-default-small,
+(2026-08-30): FreeToken v0.1.2 on Dankserver (frank-small,
 Huihui-Qwen3.6-35B-A3B-abliterated-FP8) and kingjones30/ROCmFPX
-llama.cpp on Dankclaw (frank-default-large, kingjones777
+llama.cpp on Dankclaw (frank-large, kingjones777
 Qwen3.8-Flash-Next ROCmFP4-STRIX). Both services run the Qwen-Sharp chat template.

 > 2026-08-22: the former `vllmScripts` repository is merged into the
@@ -18,7 +18,7 @@ graph LR
    subgraph Dankserver[NVIDIA Dankserver - Ubuntu 26.04]
        A[RTX 3090 24GB + 60GB RAM]
        B2[FreeToken v0.1.2
-frank-default-small, port 7770]
+frank-small, port 7770]
        C[Huihui-Qwen3.6-35B-A3B-abliterated-FP8
 block-fp8, 20% MoE residency, 453k KV / 4 streams]
        A --> B2 --> C
@@ -27,7 +27,7 @@ block-fp8, 20% MoE residency, 453k KV / 4 streams]
    subgraph Dankclaw[AMD Strix Halo - Ubuntu 26.04]
        E2[gfx1151 iGPU 64 GiB unified memory]
        E[kingjones30/ROCmFPX build
-frank-default-large, port 7770]
+frank-large, port 7770]
        F[kingjones777 Qwen3.8-Flash-Next
 ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
        E2 --> E --> F
@@ -46,18 +46,18 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]

 ## Active Deployment

- [[freetoken-frank-default-small]] — the active frank-default-small
+- [[freetoken-frank-small]] — the active frank-small
  runbook: FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-
  abliterated-FP8 on Dankserver (swapped 2026-08-30; same format/pools)
 - [[freetoken-benchmark-sweep]] — KV pool vs decode speed sweep
  (bs1/bs3/bs4/bs6, 8k–700k KV) on Dankserver RTX 3090
 - [[deployment]] — deploy and update process for both servers
 - [[frank-redo-2026-08-17]] — the 2026-08-17 topology change
- [[kingjones-strix-rocmfp4]] — ACTIVE frank-default-large runbook:
+- [[kingjones-strix-rocmfp4]] — ACTIVE frank-large runbook:
  kingjones777/Qwen3.8-Flash-Next-ROCmFP4-STRIX-GGUF, 177B params
  (56B MoE + 51.2B PLE), single 113.47 GiB GGUF, on the card's pinned
  kingjones30/ROCmFPX fork (swapped 2026-08-30)
- [[agentionai-fast-imatrix]] — retired frank-default-large runbook:
+- [[agentionai-fast-imatrix]] — retired frank-large runbook:
  agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix (87.06 GiB
  Q4_0_ROCMFP4_FAST imatrix, v2 joined PLE) on build-qwen38
  (2026-08-29 → 2026-08-30); rollback binary + payload retained
@@ -66,9 +66,9 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
 - [[eemin-rocmi4-mtp]] — the former caf-eemin Qwen3.8-27B embedded-MTP model
  on Dankclaw (retired)
 - [[dealign-ornith-crack]] — the retired Ornith-1.5-35B-A3B CRACK model on
-  Dankserver (frank-default-small, retired 2026-09-02)
+  Dankserver (frank-small, retired 2026-09-02)
 - [[ikllama-ornith-dankserver]] — the retired ik_llama.cpp runtime for
-  frank-default-small (2026-08-26): q8_0 + Hadamard KV cache,
+  frank-small (2026-08-26): q8_0 + Hadamard KV cache,
  split-mode none (single-GPU), mandatory FA_ALL_QUANTS build flags
 - [[kingjones-strix-mtp]] — the former Q6 AGENT runbook (restored 2026-09-01
  after Q8_0 failure, then superseded by the STRIX deployment on 2026-08-27)
@@ -76,9 +76,10 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
  on Dankclaw (superseded 2026-08-24 by the kingjones ROCmFP4 model)
 - [[kairic-edge]] — the retired Kairic Edge IU4 experiment
  (deployed and reverted 2026-08-22)
- [[Dankserver System Specs]] — the RTX 3090 box (frank-default-small)
- [[Dankclaw System Specs]] — the CIRU ROCmFPX box (frank-default-large)
- [[frank-default-sightsound]] — ACTIVE FLM NPU sight+sound runbook on
+- [[Dankserver System Specs]] — the RTX 3090 box (frank-small)
+- [[Dankclaw System Specs]] — the Strix Halo gfx1151 box (frank-large,
+  served on the pinned kingjones30/ROCmFPX llama.cpp fork since 2026-08-30)
+- [[frank-npu]] — ACTIVE FLM NPU sight+sound runbook on
  Dankclaw: Gemma4 E4B vision+audio pack on the XDNA2 NPU (FLM v1.0.1, port
  7771, whole-registry serving, per-request model routing), incl. the
  IOMMU/SVA root cause and the `iommu=pt` fix behind its first-deploy crash
@@ -101,8 +102,10 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
 - [[VLLM Overview]] — installation, CLI, API, architecture, quantization, parallelism
 - [[VLLM Index]] — quick reference with commands, endpoints, and parameter table
 - [[Running Qwen3.6 35B A3B FP8 on Dankserver]] — Qwen3.6-35B-A3B hardware
-  notes and sizing (the historical family; frank-default-small now serves
-  Ornith-1.5-35B-A3B, see [[dealign-ornith-crack]])
+  notes and sizing (this architecture family is what frank-small
+  serves today in the Huihui abliterated FP8 variant — see
+  [[freetoken-frank-small]]; the Ornith-1.5-35B-A3B CRACK checkpoint
+  that preceded it is archived at [[dealign-ornith-crack]])

 ## Memory Management

@@ -115,7 +118,7 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
 - [[Qwen3.8 PP Deployment]] — the retired pipeline-parallel head + worker
 - [[qwen3.8-spec-matrix]] — Qwen3.8-27B spec history (superseded by FastMTP)
 - [[FastFlowLM NPU Inference]] — the retired FastFlowLM NPU endpoint
- [[frank-default-large-benchmark]] — backend/spec benchmark behind the old head
+- [[frank-large-benchmark]] — backend/spec benchmark behind the old head
 - [[dankserver-vram-growth]] — VRAM/RAM growth behind the retired cuBLAS crash
 - [[DFlash DSpark Speculative Decoding]] — retired DFlash/DSpark drafting
 - [[Quantization by Hardware Architecture]] — which quant format fits which GPU/CPU
@@ -134,7 +137,7 @@ ROCmFP4-STRIX, 401k ctx / 2 slots, mmap PLE]
 ## Related

 - [Project knowledge base](../index.md) — the Podman app stacks on the same
-  two hosts. OpenWebUI consumes the `:7770` endpoint on Dankserver. The
-  Gitea instance on Dankclaw hosts this repository.
+  two hosts. OpenWebUI (Dankclaw) consumes the on-host `frank-large`
+  endpoint at `:7770`. The Gitea instance on Dankclaw hosts this repository.
 - [Deployment Flow](../Architecture/Deployment%20Flow.md) — the service-scoped
  git-based deploy with inference isolation