docs: record the wire rename, the OpenWebUI re-key, and the frank-primary bench drop-in trap
- AGENTS.md Model Config: the Protoss names are now the ids on the wire (per-endpoint knob named); verify a rename on /v1/models, never on a chat response — radiance echoes the requested name - OMP Harness.md: harness id == served id; one id per model everywhere - Homepage.md: the docs-page "api id" annotations and the switchover promise are retired - OpenWebUI.md: the id-keyed trio (model row, access_grant, api_configs model_ids) is a foreign-key set — re-key it in the same deploy; plus the contenteditable-composer probe note - frank-secondary/frank-large/frank-primary runbooks: served ids frank-zealot/frank-dragoon/frank-archon, and the bench.conf drop-in that made every frank-primary deploy since 2026-10-08 04:09 restart the staging worktree behind a green health gate
This commit is contained in:
1 parent
7c77326c33
commit
2992a7ddd6
7 files changed
+97
-16
No files matched your search
@@ -25,7 +25,7 @@ conversation slot and unquantized KV back.
|
||||
| | |
|
||||
|---|---|
|
||||
| Host / device | Dankclaw (192.168.0.143), RTX 3090, 24,576 MiB |
|
||||
| Endpoint | `http://192.168.0.143:7771` — alias `frank-secondary`, `/v1` OpenAI surface |
|
||||
| Endpoint | `http://192.168.0.143:7771` — served model id **`frank-zealot`** (`ALIAS` in the env; the SERVICE keeps the `frank-secondary` name), `/v1` OpenAI surface |
|
||||
| Runtime | llama.cpp master (0.5.0-dev, commit `5fc4f3c`), CUDA sm_86 build `…/llama-master/build-cuda/bin/llama-server` (`GGML_CUDA_FA_ALL_QUANTS=ON`); `qwen35` is registered in the build's own `src/llama-arch.cpp` and `src/models/qwen35.cpp` exists at that commit |
|
||||
| Unit | root systemd `frank-secondary.service` ([`scripts/frank-secondary.service`](../../scripts/frank-secondary.service)), `User=dank`, `Restart=on-failure`, `LimitMEMLOCK=infinity` |
|
||||
| Serve script | [`scripts/serve-frank-secondary.sh`](../../scripts/serve-frank-secondary.sh), tunables [`scripts/frank-secondary.env`](../../scripts/frank-secondary.env) |
|
||||
@@ -96,7 +96,15 @@ which is what the engine printed. The `n_ctx_seq (200704) < n_ctx_train
|
||||
(262144)` line is informational (a context **below** the trained window is
|
||||
safe; the Gemma4 era's warning was the opposite case, a drafter running 53 %
|
||||
**past** its window). Weights load in ~6 s from page cache; `/health` answers
|
||||
`{"status":"ok"}` and `/v1/models` serves the alias `frank-secondary`.
|
||||
`{"status":"ok"}` and `/v1/models` serves the alias `frank-zealot`.
|
||||
|
||||
**Wire rename (2026-10-09):** `ALIAS` moved `frank-secondary` → `frank-zealot`,
|
||||
so the served id matches the harness model id and the family-facing name.
|
||||
Consumers re-keyed in the same change: OpenWebUI (`model` row, `access_grant`
|
||||
row, `openai.api_configs` index-2 `model_ids`) and `models.yml` (already
|
||||
renamed 2026-10-08). llama.cpp does NOT validate the requested model name —
|
||||
it answers and echoes the served alias — so a stale client keeps working;
|
||||
the picker and any id-keyed grant is what breaks. See [[OpenWebUI]].
|
||||
|
||||
The deploy's Playwright gate passed (33 tests) and the fleet e2e set is
|
||||
unchanged.
|
||||
|
||||
Reference in new issue
Block a user