diff --git a/scripts/frank-zealot.service b/scripts/frank-zealot.service index 907d16c..b74759e 100644 --- a/scripts/frank-zealot.service +++ b/scripts/frank-zealot.service @@ -1,5 +1,5 @@ [Unit] -Description=llama.cpp (PrismML build 10777) Ternary-Bonsai-2-9B PQ2_0-MTP GGUF (qwen35 hybrid, 2x262144 slots over one 524288 pool, unquantized f16 K+V, MTP off, mmproj Q8_0 vision) on the RTX 3090 (dankclaw, frank-zealot) +Description=llama.cpp (PrismML build 10777) Ternary-Bonsai-2-9B PQ2_0-MTP GGUF + refusal adapter (qwen35 hybrid, 3x200704 slots over one 602112 pool, f16 K + q8_0 V, MTP armed, mmproj Q8_0 vision) on the RTX 3090 (dankclaw, frank-zealot) After=network-online.target Wants=network-online.target diff --git a/serverAppConfigs-docs/LLM/frank-zealot.md b/serverAppConfigs-docs/LLM/frank-zealot.md index 5de21fd..27cfc78 100644 --- a/serverAppConfigs-docs/LLM/frank-zealot.md +++ b/serverAppConfigs-docs/LLM/frank-zealot.md @@ -69,6 +69,17 @@ happened. The adapter's own card table is **not** evidence here: it was measured packing. Rollback is `LORA_FILE=` (empty) in the env and one redeploy — no rebuild, no payload move; `LORA_SCALE=0` is the same result through the flag. +**Measured on the cutover boot (2026-10-19, `02d04bc`).** Before: both probe prompts +opened `I cannot provide…`. After: neither carries a refusal marker — one ran to its +2 048-token cap, the other finished at 1 930 — so the direction is out. It still +volunteers a `⚠️ Important Disclaimer` heading before answering, which is style, not the +circuit: the marker sentence is gone, and a leading hedge is not an escape hatch. Chat, +tools (`tool_calls` with valid JSON) and vision ("Red", 281 prompt tokens) answered from +the same boot, and `DropInPaths` came back empty. Read the ledger, not this paragraph, +for provenance: the fork prints the adapter's `prism.abliterate.*` keys — including the +`base_gguf = Ternary-Bonsai-2-9B-PTQ1_0.gguf` line — at every start, so the packing +mismatch is visible in the journal to anyone who boots it. + **Harness contract** (`~/.omp/agent/models.yml`, provider `llamacpp (dankclaw-3090)`, id `frank-zealot`): `contextWindow: 200704` — **the per-slot window**, because llama.cpp divides `--ctx-size` across slots and answers a longer prompt with a 400, never a truncation — plus `maxTokens: 16384`, `input: [text, image]`