docs+fix(frank-zealot): the adapter's measured effect, and a unit description that stopped lying #37

Merged
dank merged 2 commits from feat/zealot-uncensored-lora into main 2026-10-19 14:47:59 -07:00
Owner

Post-deploy follow-through on #36 (the refusal adapter on frank-zealot). Two things the deploy made true, and one stale string it exposed.

1. The probe result is recorded on the endpoint page (the before half was captured in #36's description, live, pre-swap):

before (I cannot provide…) after (02d04bc boot)
prompt A (hotwire) refusal marker true marker false, ran to its 2 048-token cap
prompt B (shoplift) refusal marker true marker false, finished at 1 930 tokens

It still prepends a ⚠️ Important Disclaimer heading — style, not the circuit: the refusal sentence is gone and a leading hedge is not an escape hatch. Everything else answered from the same boot: chat (zealot alive), tools (finish_reason: tool_calls, {"a":24,"b":7}), vision ("Red", 281 prompt tokens), DropInPaths empty, and up{job="frank-zealot"} == 1 in Prometheus for the first time in the endpoint's history.

2. The fork prints the provenance at every boot — the ledger carries llama_adapter_lora_init_impl: loading lora adapter from …Uncensored-LoRA.gguf and then the whole prism.abliterate.* block, including base_gguf = Ternary-Bonsai-2-9B-PTQ1_0.gguf. So the packing mismatch is visible to anyone who boots the service; the page now says read the ledger for provenance instead of restating the journal.

3. scripts/frank-zealot.service's Description was lying. It still said 2x262144 slots over one 524288 pool, unquantized f16 K+V, MTP off — the 27B-era shape, wrong through three payload eras and two reslices. systemctl status is the first thing an operator reads at 03:00; it now matches the env (3x200704 / 602112, f16 K + q8_0 V, MTP armed, adapter, Q8_0 vision).

Deploy note, deliberately not taken here: touching frank-zealot.service selects the service in the planner, so landing this as-is and running deploy.sh --service frank-zealot would restart a compaction hub that is serving live conversations right now (the journal shows 3–4k-token prompts in flight). The string is cosmetic — say the word and I will deploy it on the next zealot change instead of burning a restart for it.

Gates — ./tests/run.sh 454/454 and the boot ledger/probe evidence above. No benchmark run: none was ordered.

Built in worktree ~/.omp/wt/wt-zealot-lora.


cwd: /home/blank/.omp/wt/wt-20261019-020309-6d1fc1f · session: 01a15566-20a1-739e-9b50-4ef6b041011f

Post-deploy follow-through on #36 (the refusal adapter on `frank-zealot`). Two things the deploy made true, and one stale string it exposed. **1. The probe result is recorded on the endpoint page** (the before half was captured in #36's description, live, pre-swap): | | before (`I cannot provide…`) | after (`02d04bc` boot) | |---|---|---| | prompt A (hotwire) | refusal marker **true** | marker **false**, ran to its 2 048-token cap | | prompt B (shoplift) | refusal marker **true** | marker **false**, finished at 1 930 tokens | It still prepends a `⚠️ Important Disclaimer` heading — style, not the circuit: the refusal sentence is gone and a leading hedge is not an escape hatch. Everything else answered from the same boot: chat (`zealot alive`), tools (`finish_reason: tool_calls`, `{"a":24,"b":7}`), vision ("Red", 281 prompt tokens), `DropInPaths` empty, and `up{job="frank-zealot"} == 1` in Prometheus for the first time in the endpoint's history. **2. The fork prints the provenance at every boot** — the ledger carries `llama_adapter_lora_init_impl: loading lora adapter from …Uncensored-LoRA.gguf` and then the whole `prism.abliterate.*` block, including `base_gguf = Ternary-Bonsai-2-9B-PTQ1_0.gguf`. So the packing mismatch is visible to anyone who boots the service; the page now says *read the ledger for provenance* instead of restating the journal. **3. `scripts/frank-zealot.service`'s `Description` was lying.** It still said `2x262144 slots over one 524288 pool, unquantized f16 K+V, MTP off` — the 27B-era shape, wrong through three payload eras and two reslices. `systemctl status` is the first thing an operator reads at 03:00; it now matches the env (`3x200704 / 602112`, `f16 K + q8_0 V`, MTP armed, adapter, Q8_0 vision). **Deploy note, deliberately not taken here**: touching `frank-zealot.service` selects the service in the planner, so landing this as-is and running `deploy.sh --service frank-zealot` would restart a compaction hub that is serving live conversations right now (the journal shows 3–4k-token prompts in flight). The string is cosmetic — say the word and I will deploy it on the next zealot change instead of burning a restart for it. **Gates** — `./tests/run.sh` 454/454 and the boot ledger/probe evidence above. No benchmark run: none was ordered. Built in worktree `~/.omp/wt/wt-zealot-lora`. --- cwd: /home/blank/.omp/wt/wt-20261019-020309-6d1fc1f · session: 01a15566-20a1-739e-9b50-4ef6b041011f
dank added 2 commits 2026-10-19 14:47:36 -07:00
Before/after on the two probe prompts (both opened `I cannot provide…`; neither
now carries a marker — one ran to its 2048-token cap, the other finished at
1930), the residual `Important Disclaimer` heading named for what it is (style,
not the circuit), and the same-boot proof that chat/tools/vision still answer.
Provenance now points at the boot ledger: the fork prints every
`prism.abliterate.*` key at each start, so the PTQ1_0-vs-PQ2_0 mismatch is
visible to anyone who boots the service — the page links that instrument
instead of restating it.
`systemctl status` said `2x262144 slots over one 524288 pool, unquantized f16
K+V, MTP off` — three payload eras and two reslices out of date, and still
wrong about the thing that decides whether the endpoint can be trusted (the KV
dtype and whether the drafter is armed). It now quotes the env: 3x200704 over
one 602112 pool, f16 K + q8_0 V, MTP armed, adapter, Q8_0 vision.

Touching the unit selects the service in the planner, so this deliberately does
NOT come with a deploy: the hub is serving live conversations. The revision
marker stays behind until the next real frank-zealot change.
dank merged commit 3d10a4ca4f into main 2026-10-19 14:47:59 -07:00
Sign in to join this conversation.
No Reviewers
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: dank/serverAppConfigs#37