llm: retire the trio service names — fleet services renamed to frank-archon/frank-dragoon/frank-zealot

The 2026-10-09 wire aliases become the service names everywhere:
systemd units, serve scripts, env files and FRANK_* variables,
deploy-plan/deploy-remote service keys, container names, Prometheus
job names + alert rules, Grafana dashboard queries, bats seams,
runbook filenames, homepage/AGENTS lore, and historical prose.
Rollback tags renamed in lockstep. Residue in the tree: zero.
Retired frank-medium/small/npu names are history and stay.

Known casualty: scripts/patches/*.patch context lines were rewritten;
those retired-era vLLM-fork patches no longer apply byte-exact.
This commit is contained in:
Frank committed 2026-10-10 17:03:14 -07:00
1 parent 5ced474eb9
commit 55f87fcdce
195 files changed
+2085 -2064

No files matched your search

@@ -1,27 +1,27 @@
---
type: configuration
title: FreeToken frank-secondary Runbook
description: RETIRED 2026-09-15 - FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8 as frank-secondary on Dankserver (RTX 3090 era).
title: FreeToken frank-zealot Runbook
description: RETIRED 2026-09-15 - FreeToken v0.1.2 serving batsclamp/Huihui-Qwen3.6-35B-A3B-abliterated-FP8 as frank-zealot on Dankserver (RTX 3090 era).
tags:
- freetoken
- dankserver
- frank-secondary
- frank-zealot
- qwen3.6
- moe
- fp8
timestamp: 2026-08-30
---
# FreeToken frank-secondary Runbook
# FreeToken frank-zealot Runbook
> **RETIRED 2026-09-15.** The RTX 3090 left Dankserver and the successor
> [[frank-medium-rocmfpx]] (charlie12345/ROCmFPX llama.cpp on 2x Radeon AI
> PRO R9700) took the :7770 endpoint and the port. This page is kept as the
> retirement record of the FreeToken/CUDA era; the unit was archived to
> `~/.AGENTTRASH/20260915-frank-secondary-retire/host-units/` and the repo files
> `~/.AGENTTRASH/20260915-frank-zealot-retire/host-units/` and the repo files
> to `scripts/.AGENTTRASH/`.
The `frank-secondary` service on Dankserver is served by
The `frank-zealot` service on Dankserver is served by
**FreeToken v0.1.2** — an edge-native MoE serving engine that keeps
expert weights in host RAM with an LRU GPU cache. Model history on this
runtime: official `Qwen/Qwen3.6-35B-A3B-FP8` (since 2026-09-02) →
@@ -134,8 +134,8 @@ modelopt block-fp8 remains the only FP8 path that loads.
## Sampling
**frank-secondary samples by default, and our config never said so.**
`scripts/serve-frank-secondary.sh` passes no sampling arguments at all — only
**frank-zealot samples by default, and our config never said so.**
`scripts/serve-frank-zealot.sh` passes no sampling arguments at all — only
`--model`, `--served-model-name`, `--host`, `--port`, `--moe-cache-size`,
`--num-tokens` and `--max-running-requests`. The behaviour comes from the
runtime's own default:
@@ -158,9 +158,9 @@ sampling parameters sent at all** produced three different reasoning traces
(sha `13ca02…`/487 chars, `d49928…`/540, `7b81b8…`/577). Greedy decoding
would be byte-identical.
### This is the opposite of frank-large
### This is the opposite of frank-dragoon
| | frank-secondary (FreeToken) | frank-large (halogen) |
| | frank-zealot (FreeToken) | frank-dragoon (halogen) |
|---|---|---|
| Silent client (no `temperature`) | **samples** at temp 1.0 / top_k 20 / top_p 0.95 | **greedy** — no server-side sampler defaults |
| Deterministic across runs | No | Yes |
@@ -168,7 +168,7 @@ would be byte-identical.
A client that talks to both endpoints and sends no sampler gets
non-deterministic answers from :7770 on Dankserver and reproducible ones from
:7770 on Dankclaw. If a workflow needs determinism from frank-secondary it must
:7770 on Dankclaw. If a workflow needs determinism from frank-zealot it must
send `temperature: 0` explicitly, or the service must be relaunched with
`--sampling-defaults none` (framework defaults only).
@@ -188,9 +188,9 @@ send `temperature: 0` explicitly, or the service must be relaunched with
| File | Purpose |
|------|---------|
| `scripts/serve-frank-secondary.sh` | Serve script (launches `ft serve`) |
| `scripts/frank-secondary.env` | Tunables (model path, pool sizes) |
| `scripts/frank-secondary.service` | Systemd unit |
| `scripts/serve-frank-zealot.sh` | Serve script (launches `ft serve`) |
| `scripts/frank-zealot.env` | Tunables (model path, pool sizes) |
| `scripts/frank-zealot.service` | Systemd unit |
## Limitations
@@ -209,7 +209,7 @@ send `temperature: 0` explicitly, or the service must be relaunched with
- **`model` field is required** in `/v1/chat/completions` bodies —
FreeToken rejects requests without it with a 422 (`Field required`),
unlike llama.cpp's server which defaults to the loaded model. Send
`"model": "frank-secondary"`.
`"model": "frank-zealot"`.
- Load on this swap took well under the old llama.cpp numbers:
weights → experts (parallel build) → CUDA graph capture → Uvicorn
in ~2 minutes; the 2026-08-30 swap verified ~40 tok/s decode on a